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Abstract 

A  two-phase  methodology  for  selecting  an  optimal  mili¬ 
tary  satellite  servicing  system  is  developed  using  the  sys¬ 
tems  engineering  approach.  This  methodology  is  used  to 
evaluate  several  alternative  systems  at  varying  levels  of 
detail.  The  candidate  systems  are  composed  of  low-G  launch¬ 
ers.  high-G  launchers,  orbital  servicing  vehicles,  and  space 
bases.  An  optimal  realization  is  then  derived  for  a  svstem 
of  low-G  launchers  and  orbital  servicing  vehicles.  In  the 
first  phase  of  the  approach,  vector  optimization  techniques 
are  used  to  vary  the  states  of  a  model  to  obtain  a  set  of 
optimal  solutions.  The  second  phase  embodies  the  decision 
maker's  preferences  in  a  value  system  to  enable  preference 
ranking  of  the  optimal  solutions  in  the  non-dom i nated  solu¬ 
tion  set.  This  methodology,  as  presented,  can  be  applied  to 
any  complex  problem  with  multiple  conflicting  objectives. 

It  is  designed  for  use  by  an  engineering  organization  sup¬ 
porting  a  senior-level  decision  maker. 


I .  Introduction 


1 . 1  Background 

Satellites  cost  a  great  deal  of  money.  Once  placed  in 
orbit,  a  failure  of  any  number  of  subsystems  can  make  the 
satellite  useless.  Until  recently,  the  United  States  was 
unable  to  retrieve  malfunctioning  satellites,  and  the  satel¬ 
lite  was  considered  a  total  loss.  But  demonstrations  using 
the  Space  Shuttle  have  proven  that  on-orbit  servicing  and 
repair  of  such  satellites  is  now  possible. 

The  concept  of  doing  repair  work  or  servicing  in  space 
is  not  new.  In  fact,  it  has  been  evolving  steadily 
throughout  the  lifetime  of  the  United  States  space  program. 
Astronauts  performed  the  first  minor  space  repairs  on  their 
Gemini  and  Apollo  spacecraft  during  the  1960s.  Other 
astronauts  performed  even  more  dramatic  repairs  aboard  the 
first  American  manned  orbiting  laboratory,  Skylab. 

Shortly  after  launch  on  May  14,  1973,  telemetry  data 
indicated  problems  with  the  yet  unmanned  Skylab.  The 
sunshield  had  torn  off  creating  temperatures  inside  the 
craft  too  high  for  human  survival.  Additionally,  one  of  the 
two  main  solar  arrays  was  missing  and  the  other  one  was 
Jammed  in  a  near-closed  position. 

By  the  time  the  first  Skylab  crew  launched  on  May  25, 
the  National  Aeronautics  and  Space  Administration  (NASA)  had 
developed  tools  and  procedures  for  the  crew  to  use  in 


repairing  Skylab.  During  the  six  months  that  the  lab  was 


manned,  the  three  crews  accomplished  many  unplanned  mainte¬ 


nance  tasks,  including  cleaning  a  telescope,  hammering  loose 


a  stuck  electric  relay,  rotating  a  jammed  filter  with  a 


screwdriver,  and  repairing  a  rate  gyro.  Including  the 


planned  servicing  activities  --  the  changing  of  film  maga¬ 


zines  --  a  total  of  ten  extravehicular  activities  (EVA)  were 


made  totalling  82.5  man-hours.  Thus  the  Skylab  experience 


provided  additional  proof  that  repair  of  space  assets  on- 


orbit  is  not  only  possible,  but  that  man  can  routinely 


accomp 1 i sh  it. 


The  success  of  the  Skylab  repairs  was  not  just  due  to 


luck  and  quick  thinking.  Large  tool  kits  were  aboard  the 


lab,  and  crews  had  completed  extensive  pre-mission  ground 


training  in  simulators.  In  short,  extensive  planning  and 


preparation  had  made  it  possible  for  NASA  to  deal  success¬ 


fully  with  the  emergency  repairs 


Ideally,  planning  for  space  repairs  should  be  part  of 


the  satellite  design,  as  was  done  with  the  Solar  Maximum 


Mission  satellite  (Solar  Max).  Solar  Max  is  the  first  of  a 


series,  known  as  the  multimission  modular  spacecraft  (MMS), 


designed  to  be  serviced  by  the  Space  Shuttle.  The  satellite 


is  modular  in  design  for  quick  access  and  removal  of  com 


ponents .  It  is  equipped  with  a  grapple  fixture  that  allows 


the  Remote  Manipulator  System  (RMS)  of  the  Shuttle  (also 


known  as  Canadarm)  to  snare  Solar  Max  and  place  it  in  the 
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bay  of  the  Shuttle.  Due  directly  to  this  design 

forethought,  the  Shuttle  was  able  to  successfully  retrieve 

and  repair  Solar  Max  when  several  failures  disabled  the 

satellite.  This  type  of  preparation  through  satellite 

design  shows  great  promise  for  future  servicing  missions  by 

the  shuttle.  Space  World  magazine  reported  that: 

A  1975  study  by  Rockwell  International  .... 
estimated  that  almost  $3  billion  could  be  saved  by 
using  extravehicular  activity  (EVA)  to  deploy, 
maintain,  or  repair  satel 1 ites . . . . (Dool ing ,  1982). 

However,  the  Shuttle  was  not  designed  to  be  primarily  a 
repair  platform  or  servicing  system.  Its  main  function  is 
still  as  a  transportation  system  between  Earth  and  low  earth 

orbit  (LEO) . 

* 

Designing  serviceable  satellites  does  depend  on  the 
type  of  system  doing  the  servicing,  as  was  the  case  with 
Solar  Max  and  the  Canadarm  system.  Conversely,  the  design 
of  the  servicing  system  is  also  dependent  on  the  system  to 
be  serviced.  Both  considerations  are  important  if  satellite 
servicing  is  to  become  routine. 

The  commitment  of  this  nation  to  achieve  and  maintain  a 
position  of  leadership  in  space  transportation  was  esta¬ 
blished  by  the  enactment  of  the  National  Space  Policy  of 
1982.  President  Reagan  emphasized  this  commitment  when  he 
directed  NASA  on  25  January  1984  to  develop  a  permanently 
manned  space  station  within  a  decade. 


NASA  and  the  Air  Force  have  both  made  commitments  to 
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make  their  satellites  serviceable.  As  a  result  of  the 

United  States  Air  Force  Spacecraft  Maintenance  Policy  Review 

Study  (Dept,  of  AF ,  1984)  the  Undersecretary  of  the  Air 

Force  for  Research  and  Development  directed  that: 

The  Air  Force  policy  is  to  ensure  that  spacecraft 
maintenance  options  are  considered  in  requirements 
definition,  acquisition  program  management,  and 
contractual  documentation  for  those  satellite  pro¬ 
grams  wherein  these  options  might  be  reasonably 
implemented.  The  Air  Force  should  actively  exam¬ 
ine  the  utility  of  spacecraft  maintenance  options 
(particularly  preventative  maintenance,  refueling 
and  repair)  and  avoid,  wherever  practicable, 
design  actions  which  would  appear  to  preclude  on- 
orbit  maintenance  later  in  the  spacecraft  life 
cycle  (Aldridge,  1984). 


In  May  1985,  the  USAF  Space  Division  issued  a  Request 

For  Proposal  (RFP)  for  contractors  to  develop  alternatives 

for  a  Space  Transportation  Architecture.  As  stated  in  the 

statement  of  work  portion  of  the  RFP: 

The  primary  objectives  of  this  study  are  to  (1) 
determine  the  overall  space  transportation 
archi tecture( s )  and  transportation  systems  that 
can  most  cost  effectively  perform  future  DOU  and 
NASA  missions  projected  for  the  1995  through  2010 
time  period,  (2)  identify  the  enabling  technolo¬ 
gies  required  for  future  space  transportation  sys¬ 
tems  and  prepare  an  integrated  plan  to  develop 
these  technologies,  and  (3)  refine  the  mid-l990’s 
transportation  system  concept(s),  and  prepare 
preliminary  system  specifications  and  special 
engineering  plans  for  refined  concept(s)  to  facil¬ 
itate  the  start  of  the  Validation  Phase  (Dept,  of 
AF,  1985). 


y. 


It  is  to  a  request  such  as  this  one  that  this  design 
project  is  addressed.  Specifically,  a  methodology  is 
developed  and  demonstrated  for  selecting  a  military 
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satellite  servicing  architecture  from  among  many  candidates. 


There  are  two  approaches  which  may  be  used  to  make 


decisions  such  as  this:  the  traditional  engineering  approach 


or  the  systems  engineering  approach.  In  the  traditional 


approach,  although  large  amounts  of  detailed  information  are 


gathered,  there  is  a  tendency  not  to  evaluate  requirements 


and  tradeoffs.  The  systems  engineering  approach  ensures 


that  this  is  done. 


The  traditional  approach  to  the  selection  or  design 


process  begins  with  establishing  a  set  of  minimum  system 


requirements.  Candidate  systems  that  do  not  at  least  meet 


these  requirements  are  eliminated.  When  one  or  more  systems 


are  found  that  satisfy  the  minimum  requirements,  an  arbi 


trary  selection  of  one  of  them  is  normally  made.  Design 


work  is  then  started  on  that  system's  subcomponents.  Since 


other  systems  may  exceed  the  minimum  requirements,  but  were 


not  examined,  this  approach  usually  results  in  selection  of 


a  system  that  is  less  than  optimal  in  cost  or  performance. 


Typically,  the  majority  of  the  design  work  in  the  tradi 


tional  approach  is  spent  on  designing  each  little  piece  of 


the  system.  Late  in  the  design,  the  little  pieces  are 


forced  to  interface,  and  only  then  are  integration  problems 


discovered.  In  addition,  cost  overruns  and  design  changes  on 


each  little  piece  affect  the  total  system’s  efficiency. 


which  is  only  as  good  as  the  least  efficient  piece  in  the 


system.  Because  the  traditional  engineering  approach  does 
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not  usually  include  tradeoffs  that  analyze  changes  to  parts 
of  the  total  system,  the  system  discrepancies  are  not 
discovered  until  late  in  the  design  process.  In  conclusion, 
the  traditional  engineering  approach  can  be  an  inefficient 
method  for  solving  complex  problems,  and  often  does  not 
identify  the  optimal  solution. 

In  contrast,  the  systems  engineering  approach  presents 
an  efficient  methodology  for  designing  today’s  complex  sys¬ 
tems.  Requirements  are  used  along  with  the  constraints  of 
the  design  project  to  define  all  acceptable  candidate  sys¬ 
tems.  Those  systems  that  exceed  the  requirements  while 
satisfying  the  constraints  are  candidates  for  being  optimal 
solutions.  The  individual  candidates  are  then  optimized 
from  a  total  systems  viewpoint  versus  a  piece-by-piece 
optimization.  This  permits  identification  of  the  design 
requirements  for  the  individual  pieces  after  an  optimal 
workable  system  design  is  obtained.  The  systems  engineering 
approach  is  also  an  iterative  process  that  improves  on  the 
total  design  at  each  iteration.  The  result  is  a  set  of  can¬ 
didate  solutions,  optimized  to  achieve  the  objective  in  the 
problem  statement. 

The  objectives  of  this  study,  its  scope,  and  assump¬ 
tions  are  outlined  below. 


1-b 


1 . 2  Problem  Statement 

Develop  and  demonstrate  a  methodology  for  selecting  an 
optimal  military  satellite  servicing  system  (SSS) . 

1 . 3  Scope 

A  systems  engineering  approach  is  used  to  develop  a 
two-phase  methodology  for  selecting  an  optimal  military 
satellite  servicing  system.  The  methodology  is  designed  for 
use  by  an  engineering  organization  supporting  a  senior-level 
decision  maker.  Consequently,  the  problem  objectives  and 
measures  of  effectiveness  are  developed  from  a  senior  mili¬ 
tary  decision  maker’s  viewpoint.  Candidate  architectures 
consist  of  a  means  to  get  mass  to  orbit  (launch  vehicle  sys¬ 
tem),  and  a  means  to  service  satellites  on-orbit  (service 
vehicle  system).  Several  candidate  architectures  are 
evaluated,  with  an  optimal  realization  derived  for  a  system 
of  low~G  launchers  combined  with  orbital  servicing  vehicles. 
No  attempt  is  made  to  evaluate  the  economic  benefits  such  a 
system  could  provide  nor  are  specific  design  requirements 
for  satellite  serviceability  addressed. 

1 . 4  Assumptions 

This  study  is  based  on  the  following  assumptions. 
Further  assumptions  of  narrower  scope  will  be  presented  in 
each  section  of  this  report  where  they  apply. 


1.  A  justified  need  for  servicing  satellites  exists. 

2.  The  satellites  to  be  serviced  have  been  designed  to  be 
accessible,  and  the  satellite  requirements  will  drive 
the  design  of  the  servicing  system. 

3.  The  decision  maker  using  this  methodology  is  at  the 
Department  of  Defense  (DOD)  level  of  Government  and 
will  view  a  system’s  effectiveness  from  a  military  per¬ 
spective  . 

4.  The  satellite  servicing  system  will  be  purchased  and 
operated  by  the  Department  of  Defense. 

1 . 5  Del i verab 1 es 

This  effort  has  resulted  in  the  following: 

1.  A  two-phase  methodology  is  explained  that  is  partic¬ 
ularly  useful  for  solving  complex  problems  with  multiple 
conflicting  objectives.  This  methodology  is  applied  specif¬ 
ically  to  the  problem  of  determining  the  best  type  of  ser¬ 
vicing  architecture  to  develop  for  servicing  military  satel- 
1 i tes  on-orbi t . 

2.  Three  candidate  architectures  are  modeled  mathemati¬ 
cally;  the  equations  and  explanations  are  included  in  Appen¬ 
dices  D-F  for  these  systems: 

a)  Low-G  launch  system  with  orbital  servicing  vehicles 
(LG-OSV) 

b)  Low-G  and  fixed  high~G  launch  systems  with  orbital 
servicing  vehicles  (LG-FHG-OSV) 

c)  Low-G  and  fixed  high-G  launch  systems  with  orbital 
servicing  vehicles  and  space  bases  ( LG-FHG-OSV -SB ) 


The  entire  methodology  is  carried  out  for  the  LG-OSV 
architecture,  with  the  resulting  optimal  realizations 
included  in  this  study.  The  same  procedures  should  be  used 
for  the  other  two  alternatives,  but  time  constraints 
prevented  their  inclusion  in  this  effort. 

3.  A  discussion  of  the  orbital  mechanics  and  accompany¬ 
ing  equations  used  for  designing  the  servicing  system  models 
are  included  in  Appendix  G. 

4.  A  listing  for  a  Fortran-based  computer  program  for 
calculating  change  in  velocity  (delta  v)  and  time  of  flight 
for  an  OSV  traveling  between  a  resupply  orbit  and  a  servic¬ 
ing  orbit  is  included  in  Appendix  H.  The  servicing  orbit  is 
determined  by  the  altitude  and  inclination  of  the  satel- 

% 

lites.  The  program  is  interactive  and  allows  the  user  to 
specify  the  altitude  and  inclination  of  the  resupply  orbit, 
the  number  of  satellites  to  be  serviced  in  the  orbit  during 
that  mission,  and  the  maximum  number  of  waiting  orbits. 

There  is  also  an  option  that  calculates  propulsion  fuel  mass 
used . 

1 . 6  Sequence  of  Presentation 

Chapter  11  describes  the  two-phase  methodology  that  is 
used  in  this  study.  The  steps  of  the  methodology,  as  they 
relate  to  selecting  an  optimal  satellite  servicing  architec¬ 
ture,  are  described  in  detail  in  chapters  three  through  six. 
Chapter  III  contains  a  development  of  the  value  system,  part 
of  the  second  phase  of  the  methodology.  Chapter  IV 
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describes  the  generation  of  alternative  solutions  through 


synthesis  and  modeling.  In  Chapter  V,  the  generated  alter 
native  systems  are  optimized  and  evaluated.  Chapter  VI 
discusses  decision  making  based  on  these  optimal  solutions 
Conclusions  and  recommendations  are  in  Chapter  VII. 


1  I .  Methodo l ogy 


2 . 1  Introduction 

2.1.1  Overv i ew .  The  systems  engineering  (SE)  approach  has 
evolved  as  man  has  attempted  to  solve  large  complex  problems 
related  to  modern  technology.  The  SE  methodology  is  not  a 
rigid  procedure  for  solving  problems,  but  rather  a  set  of 
tools  and  techniques  tied  together  by  a  distinct  approach. 

In  general,  the  SE  methodology  provides  a  framework  that 
helps  one  identify  the  important  parameters  and  boundaries 
surrounding  an  issue,  aids  in  developing  and  modeling  solu¬ 
tions,  emphasizes  optimizing  these  solutions,  and  then  pro¬ 
vides  a  mechanism  for  selecting  the  most  appropriate  answer 
from  this  set  of  solutions. 

The  approach  begins  with  defining  the  problem  and  iden¬ 
tifying  an  overall  objective.  Often,  especially  in  large 
complex  problems,  this  objective  is  somewhat  vague  and  pro¬ 
vides  no  indication  of  a  direction  to  proceed  to  achieve  it. 
In  these  cases  it  is  helpful  to  decompose  the  problem  or 
overall  objective  into  manageable  subobjectives  (or  func¬ 
tional  areas),  that  provide  more  detail  about  the  problem 
under  study.  Understanding  each  of  the  subobjectives  allows 
a  broader  understanding  of  the  whole  problem,  and  conse¬ 
quently  encourages  better  solutions.  Each  subobjective  can 
be  thought  of  as  a  piece  of  a  jig-saw  puzzle.  Each  piece  by 


itself  yields  only  a  small  clue,  yet  it  is  a  necessary  part 


to  complete  the  puzzle.  By  identifying  the  shape  or  struc¬ 
ture  of  each  of  the  pieces,  it  is  easier  to  understand  how 
each  little  piece  must  fit  together  to  form  the  total  pic¬ 
ture  . 

As  an  example,  if  the  overall  objective  is  to  design  an 
economical  air  superiority  fighter  aircraft,  one  might 
define  subobjectives  to  give  more  detail  about  what  is 
needed.  One  subobjective  might  be  "must  have  optimal  per¬ 
formance"  and  another  might  be  "minimize  total  cost.” 
Satisfying  the  subobjectives  satisfies  the  overall  objec¬ 
tive.  Likewise,  these  two  subobjectives  could  be  broken 
down  even  further.  For  example,  performance  might  depend  on 
speed  capability  desired,  and  weapons  delivery  systems 
needed.  Cost  could  depend  on  initial  system  purchase  cost 
and  operating  costs.  At  the  objective  level  with  the 
highest  degree  of  detail,  one  can  usually  determine  what 
measures  of  effectiveness  are  needed  to  show  the  degree  of 
attainment  of  each  objective.  These  measures  of  effective¬ 
ness.  or  performance  indices  (PI),  can  then  be  used  to  rate 
how  well  a  candidate  solution  achieves  the  overall  objec¬ 
tive. 


Some  subobjectives  will  have  physically  measurable 
characteristics,  while  others  will  not.  in  the  example 
above,  the  engine  thrust  and  aerodynamic  drag  in  the  fighter 
design  relate  to  the  speed  capability  objective.  However, 
the  desire  for  the  fighter  to  be  a  politically  stabilizing 


2-2 


force  in  the  international  community,  would  be  an  objective 
that  cannot  be  physically  measured.  Both  are  still  valid 
objectives,  and  both  can  be  satisfied  using  the  SE  approach. 

In  a  complex  problem,  subobjectives  often  conflict  with 
each  other.  Complete  satisfaction  of  one  subobjective  may 
result  in  less  than  maximum  satisfaction  of  another.  One  of 
the  greatest  advantages  of  the  SE  approach  is  that  it  can  be 
used  on  exactly  this  type  of  problem. 

The  basis  of  the  systems  engineering  approach  is  to 
optimize  the  overall  objective  by  simultaneously  optimizing 
the  performance  indices.  This  differs  from  the  traditional 
engineering  approach,  which  has  a  tendency  to  optimize  the 
subcomponents  independently  and  then  fit  the  pieces 
together.  The  traditional  approach  may  work  well  for  prob¬ 
lems  where  the  solution  has  been  well-established  by  past 
experience.  But  in  a  complicated  problem  where  the  analysis 
procedure,  models,  or  objectives  are  not  well-established, 
the  traditional  approach  can  result  in  a  lot  of  wasted 
effort  on  an  ill-formed  problem.  Imagine  three  groups  try¬ 
ing  to  design  a  different  part  of  an  aircraft  independently, 
with  the  objectives  of  having  a  strong  structure,  a  rugged 
landing  gear,  and  a  powerful  propulsion  system.  If  the 
three  groups  did  not  coordinate  their  designs  to  achieve  a 
workable  aircraft,  the  exaggerated  results  in  Figure  2.1 
could  conceivably  occur. 


STRUCTURAL  DESIG*, 


Figure  2.1  design  of  an  Aircraft  by  Subcomponents 


By  doing  a  simultaneous  optimization,  all  of  the  sub¬ 
components  are  permitted  to  achieve  their  maximum  potential 
in  relation  to  the  other  subcomponents  in  the  entire  system. 
The  overall  objective  is  not  lost  and  the  interaction  of  the 
parts  is  maintained.  The  result  is  a  set  of  optimal  solu¬ 
tions  from  which  a  decision  maker  can  then  make  his  selec¬ 
tion  based  on  his  own  preferences. 

One  of  the  primary  characteristics  of  the  SE  approach 
is  its  iterative  nature.  In  the  first  attempt  to  solve  the 
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savins  manpower  and  money  --  an  obvious  advantage  over  the 
traditional  approach. 


In  general  the  SE  approach  can  be  applied  to  any  prob¬ 
lem.  The  approach  is  flexible  enough  to  allow  tailoring  of 
specific  steps  in  the  methodology  to  best  fit  the  problem 
being  examined.  Many  authors  have  described  this  methodol¬ 
ogy  using  steps  that  fit  the  phases  of  a  system's  life. 
Perhaps  the  most  general  description  is  given  by  Hall 
(Hal  1,1969).  He  uses  a  three-dimensional  framework  with  a 
system’s  life  phases  on  one  axis,  the  systems  engineering 
steps  on  a  second  axis,  and  knowledge  from  various  discip¬ 
lines  on  the  third  axis.  Two  of  these  dimensions  can  be 
displayed  in  an  activity  matrix  as  shown  in  Figure  2.3. 
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Figure  2.3  Hall  Activity  Matrix  for  Systems  Engineering 


The  seven  steps  of  systems  engineering  are  carried  out  in  an 


Si 


iterative  fashion.  This  means  that  it  is  possible  to  go 


back  and  refine  or  improve  the  results  of  any  lower-numbered 
step  as  a  consequence  of  the  results  of  any  higher-numbered 
step  (Sage,  1977:3).  These  seven  steps  are  repeated  for 
each  of  the  seven  system  life  phases.  The  methodology 
described  in  this  paper  will  be  an  adaptation  of  Hall’s 
approach.  Other  authors  describe  variations  that  may  be 


appropriate  for  a  particular  problem  (Chestnut,  1965; 
DeNeufville  and  Stafford,  1971;  Hill,  1970;  Sage,  1977; 
Tribus.  1969:394). 


The  SC  approach  is  particularly  well-suited  to  solving 
complex  problems  (Sage,  1977:1-3).  Determining  the  best 
combination  of  systems  to  use  for  on-orbit  servicing  of 
satellites  is  just  such  a  problem. 


2.1.2  Two-Phase  Approach.  Typically  in  problems  with  mul¬ 


tiple,  conflicting  objectives,  the  design  or  decision  pro¬ 
cess  can  be  separated  into  two  phases.  The  first  phase 
involves  problem  definition,  system  synthesis  and  modeling, 
optimization,  and  model  sensitivity  analysis  (Clark  and 
DeWispelare,  1985).  The  end  product  of  this  first  phase  is 
a  set  of  solutions  with  the  characteristic  that  no  one  solu¬ 
tion  in  the  set  can  be  considered  a  better  solution  than  any 
other,  from  an  engineering  viewpoint.  All  solutions  can  be 
considered  to  be  ’’equally  optimal."  As  an  example,  consider 
two  candidate  solutions,  A  and  B,  from  this  optimal  set. 
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System  A  may  outperform  system  B  in  the  measure  of  one  per¬ 
formance  index,  but  system  B  will  outperform  system  A  in  the 
measure  of  a  different  PI.  This  set  of  solutions  is  thus 
appropriately  termed  a  ’’nondominated  solution  set”  or 
”NDSS .  ” 

The  second  phase  of  the  approach  provides  a  mechanism 
for  including  the  preferences  or  "values”  of  the  decision 
maker  (DM).  Inclusion  of  the  decision  maker’s  "value  sys¬ 
tem”  in  the  solution  process  enables  the  analyst  to  create  a 
ranking  of  the  optimal  solutions  in  the  MDSS  based  on  the 
decision  maker’s  own  preferences.  This  ranked  listing  of 
solutions  is  an  efficient  method  for  communicating  results 
to  a  busy  decision  maker.  The  second  phase  of  the  methodol  - 
ogy  includes  designing  a  "value  system”,  ranking  the  solu¬ 
tions  in  the  NDSS,  and  selection  of  a  solution  by  the  DM  for 
imp  1 ementat ion . 

While  the  methodology  is  separated  into  two  distinct 
phases,  they  may  overlap  in  time.  Typically,  design  of  the 
value  system  is  begun  immediately  after  problem  definition. 

It  is  advantageous  to  use  this  two-phase  approach 
because  it  separates  the  costly  and  normally  t i roe- i ntens i ve 
first  ph  ase  from  the  preference  laden  and  volatile  second 
phase  (Clark  and  DeWispelare,  1985:84).  Decision  maker 
values  do  sometimes  change,  due  to  either  external  events  or 
simply  reevaiuation  by  the  DM  of  his  preferences.  However. 


as  long  as  the  essential  elements  of  the  problem  do  not 
change,  the  first  phase  does  not  have  to  be  reaccomplished, 
regardless  of  how  the  decision  maker's  preferences  change, 

2.1.3  Basic  Steps  of  the  Methodology.  The  basic  steps 
of  the  SE  approach,  using  this  two-phase  methodology,  are 
applied  in  this  study  to  the  problem  of  selecting  a  satel¬ 
lite  servicing  architecture.  Below  is  a  sequential  overview 
of  the  steps  in  the  approach.  The  sections  in  this  chapter 
will  describe  these  steps  individually. 

Application  of  the  methodology  involves  problem  defini¬ 
tion,  design  of  a  value  system,  synthesis  and  modeling  of 
alternative  solutions,  analysis  and  validation  of  those 
solutions,  alternatives  ranking  and  selection  of  an 
appropriate  solution,  and  planning  for  future  actions.  This 
same  sequence  of  steps  is  performed  over  and  over  until  one 
is  satisfied  that  the  process  has  converged  to  a  solution. 

The  first  step  in  the  approach  is  problem  definition. 
This  stage  involves  research  to  improve  understanding  of  the 
true  problem,  since  the  problem  cannot  be  defined  properly 
until  the  real  problem  is  determined.  Next,  a  value  system 
is  designed  that  expresses  the  preferences  of  the  decision 
maker.  The  value  system  identifies  important  objectives, 
and  allows  direct  systematic  mathematical  analysis  of  the 
decision  maker’s  preferences.  Again,  the  value  system  is 
part  of  the  second  phase  of  the  SE  approach,  and  is  indepen- 


dent  of  the  first  phase.  It  is  suggested  that  the  value 
system  be  designed  at  this  point  of  the  methodology.  This 
ensures  that  the  performance  indices  derived  in  the  second 
phase  by  the  decision  maker  are  the  same  performance  indices 
used  during  the  modeling  in  the  first  phase.  Although  arbi¬ 
trary  performance  measures  may  be  used  in  the  model,  this 
coordination  step  can  save  a  great  deal  of  effort  later  in 
the  solution  process.  Alternative  solutions  to  the  problem 
are  identified  or  created  in  the  third  step.  These  alterna¬ 
tive  or  candidate  solutions  are  then  modeled  to  permit 
direct  analysis.  From  the  analysis,  one  determines  how  well 
the  candidate  solutions  meet  the  objectives  established  in 
the  problem  definition  step.  This  analysis  includes  optimi¬ 
zation  of  the  alternatives,  and  validation  of  the  system 
models  and  solutions.  This  information  is  then  used  to  rank 
the  alternatives  from  most  to  least  desirable,  using  the 
decision  maker’s  preferences.  The  final  step  in  the  SE 
approach  is  planning  for  action.  This  step  will  vary,  from 
iterating  through  all  the  steps  again  to  gain  more  detail 
and  information  for  improving  the  current  solution,  to 
implementing  the  final  solution. 

2 . 2  Problem  Definition  Step 

Problem  definition  is  the  key  initial  step  in  the  SE 
approach.  In  this  step  the  framework  for  the  rest  of  the 
process  is  set.  Considerable  care  must  be  taken  to  ensure 
that  the  "real”  problem  is  identified  and  addressed.  It  is 
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also  inportant  to  determine  not  only  the  overall  problem  or 
goal,  but  also  the  decision  situation  that  brought  about 
consideration  of  this  problem.  Other  important  items 
requiring  identification  during  the  problem  definition  step 
include:  the  ’’actors”  involved  in  the  problem,  what  factors 

can  and  cannot  be  controlled,  and  the  likely  system  inputs 
and  desired  outputs. 


Flexibility  is  necessary  during  this  step,  since 
knowledge  gained  during  later  iterations  should  be  used  to 
modify  the  problem  definition  when  appropriate.  The  first 
attempt  at  the  problem  definition  is  usually  rather 
abstract:  necessary  details  can  be  added  on  later  itera¬ 
tions.  Once  a  problem  definition  is  formulated,  the  analyst 
should  ask  the  decision  maker  to  confirm  that  it  is  indeed 
the  problem  of  interest. 


2.2.1.  Decision  Situation  and  Actors.  It  is  important  to 
fully  understand  the  factors  that  created  the  issue  under 
consideration  in  order  to  set  the  problem  boundaries. 
Interviews  with  the  ’’actors”  involved  in  the  problem  and 
thorough  research  will  enable  one  to  establish  this  frame¬ 
work.  The  actors  are  the  individuals  who  are  affected  by 
the  problem,  and  the  i nd i v i dua 1 ( s )  responsible  for  solving 
or  implementing  a  solution.  Sometimes  these  groups  are 
identical.  Identification  of  the  actors  also  identifies  the 
•r'  decison  makeris)  for  the  issue.  The  decision  maker  is  "an 

individual  or  a  group  of  individuals  who  directly  or 
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indirectly  furnishes  the  final  value  judgement  that  may  be 
used  to  rank  available  alternatives,  so  that  the  ’best’ 


choice  can  be  identified  .  whenever  final  value  judge¬ 

ments  need  to  be  made  concerning  the  ’goodness’  or  ’badness’ 
of  a  given  choice,  they  are  to  be  made  by  the  decision 
maker’’  (Chankong  and  Haimes,  1983:8). 

2.2.2  Controllable  Factors  and  System  1 nputs / Outputs .  Once 
the  decision  situation  and  actors  have  been  identified,  the 
system  parameters  must  be  analyzed.  This  involves  determin¬ 
ing  the  constraints  of  the  problem  and  identifying  the 
alterables,  or  problem  factors  that  can  be  controlled.  It 
is  also  necessary  to  isolate  and  relate  the  relevant  vari¬ 
ables  involved  in  the  problem. 

Hall  suggests  one  technique  for  determining  the  system 
inputs  and  outputs  by  imagining  the  total  system  as  a  "black 
box"  (Hall,  1962:99).  Inputs  to  the  system  are  listed  arbi¬ 
trarily  on  one  side  of  the  box  and  outputs  on  the  other. 
Following  this  ”f ree-thought”  process,  the  analyst  attempts 
to  match  the  correct  inputs  with  the  corresponding  outputs. 
If  this  is  not  yet  possible,  the  black  box  should  be  broken 
into  subsystems,  and  the  process  repeated. 

Another  method  for  determining  the  important  components 
in  the  problem  definition  is  the  ”who-what-when-where-why ’’ 
approach.  By  answering  each  of  the  ”w”  questions,  one  can 
normally  get  a  feel  for  the  scope  of  the  problem  and  the 
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variables  involved 


After  properly  defining  the  problem  in  the  first  step, 
the  analyst  will  be  able  to  state  the  overall  objective  of 
the  problem.  The  overall  objective  is  needed  to  design  a 
value  system  for  the  decision  maker.  As  described  earlier, 
design  of  the  value  system,  although  part  of  the  second 
phase  of  the  methodology,  is  typically  begun  after  the  prob¬ 
lem  definition. 


The  design  of  the  value  system  in  a  complex  problem 
usually  begins  with  the  creation  of  a  hierarchy  tree  of 
objectives.  The  decision  situation  or  overall  objective  is 
placed  at  the  top  of  the  tree.  Those  objectives  whose  suc¬ 
cessful  accomplishment  would  result  in  reaching  the  overall 
objective  are  placed  at  the  second  level  of  the  tree.  This 
is  continued  until  a  level  is  reached  where  the  attainment 
of  an  objective  can  be  directly  measured.  These  measures  of 
performance,  or  performance  indices,  indicate  the  relative 
level  of  achievement  of  the  objectives.  There  is  not  a 
unique  hierarchy  of  objectives  for  any  problem.  Conse¬ 
quently,  if  the  analyst  creates  the  hierarchy  of  objectives 
for  the  decision  maker,  it  is  recommended  that  the  decision 
maker  approve  and  agree  with  the  problem  as  it  is  struc¬ 
tured  . 


The  level  of  objective  attainment  measured  by  each 
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performance  index  at  the  bottom  of  the  hierarchy  tree  will 
be  different  for  each  candidate  solution  in  the  NDSS.  Con¬ 
sequently,  every  decision  maker  will  prefer  one  solution 
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over  another,  based  either  on  established  policies,  or  on 
personal  bias  from  his  own  experiences.  The  purpose  of  the 
value  system  is  to  capture  those  preferences  for  inclusion 
in  the  solution  process.  The  value  system  is  an  organized 
method  for  discriminating  among  a  set  of  otherwise  equally 
optimal  solutions  (from  an  engineering  point-of-view) . 


In  a  complex  problem,  there  will  be  many  different  ways 
to  measure  the  degree  of  attainment  of  the  objectives  using 
different  performance  indices.  Consequently,  it  is  recom¬ 
mended  that  the  performance  indices  at  the  bottom  of  the 
hierarchy  tree  be  used  as  the  measures  of  performance  for 
the  candidate  solutions  in  the  NDSS.  This  is  necessary 
before  any  modeling  has  begun  to  ensure  that  the  model  out¬ 
puts  the  desired  measures.  Otherwise  considerable  effort 
may  be  required  later  to  convert  the  NDSS  values  to  the  per¬ 
formance  index  values  needed  for  the  hierarchy  tree.  After 
the  objective  tree  and  performance  index  measures  have  been 
established,  the  preferences  of  the  decision  maker  do  not 
have  any  impact  on  the  solution  process  until  the  first 
phase  of  the  methodology  has  been  completed.  The  remainder 
of  the  value  system  design  can  be  accomplished  independently 
from  the  first  phase  steps. 


The  analyst  next  investigates  the  preferences  the 
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decision  naker  has  for  different  objectives  and  for  the 
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units  that  measure  those  objectives.  Every  decision  maker 


will  have  a  different  utility  or  degree  of  satisfaction 


associated  with  the  measure  used  for  each  performance  index. 


If  the  measure  of  a  performance  index  for  initial  cost  is  in 


dollars,  a  decision  maker  may  have  different  utilities  asso¬ 


ciated  with  various  quantities  of  dollars.  tor  instance,  he 


may  prefer  a  system  costing  $100  million  versus  a  system 


costing  $10  billion.  This  degree  of  satisfaction  can  be 


represented  by  a  utility  curve.  This  curve  maps  the  range 


of  measures  of  a  performance  index  to  the  value  that  Dll 


associates  with  each  measure.  A  decision  maker  may  also 


have  different  preferences  associated  with  each  objective  in 


the  hierarchy  tree.  He  may  desire  to  emphasize  the  accom¬ 


plishment  of  one  objective  over  the  accomplishment  of 


another.  The  analyst  determines  these  types  of  preferences 


by  having  the  decision  maker  do  preference  comparisons  for 


the  objectives  on  each  level  of  the  tree.  This  process 


allows  a  decision  maker  to  rank  objectives  two-at-a-t ime , 


enabling  him  to  give  a  greater  weight  or  emphasis  to  those 


objectives  that  he  feels  are  important.  Chapter  111 


describes  these  methods  and  how  they  are  implemented. 


2 . 4  Alternatives  Generation  Step  (System  Synthesis  and 
Mode  ling) 


Identification  or  creation  of  alternative  solutions  is 


the  next  step  in  the  SE  approach.  Primarily  this  involves 
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determining  different  ways  to  attain  each  objective, 
describing  each  alternative  approach,  and  measuring  the 
degree  of  attainment  of  each  approach.  Often  this  is  termed 
system  synthesis  (Sage,  1977:73).  Research  accomplished 
during  the  problem  definition  phase  will  undoubtedly  iden¬ 
tify  some  potential  candidate  solutions.  However,  it  is 
desired  to  include  as  many  potential  solutions  as  possible, 
to  preclude  overlooking  a  viable  candidate.  Brainstorming 
is  an  excellent  technique  for  a  first  attempt  at  generating 
solutions.  (Sage,  1977:167-176)  describes  the  merits  of 
using  brainstorming,  brainwriting,  and  Delphi  techniques  for 
generation  of  ideas  in  a  group.  The  primary  goal  is  to 
identify  as  many  different  ways  as  possible  to  accomplish 
the  objectives  defined  in  the  problem  definition.  Since 
this  methodology  uses  an  iterative  approach  and  optimizes 
the  candidates  that  are  generated,  unworkable  ideas  will 
quickly  fall  out . 

Once  a  set  of  candidates  has  been  generated,  some 
method  of  describing  and  analyzing  these  alternatives  must 
be  used.  Typically,  the  different  system  alternatives  are 
described  in  terms  of  a  model.  In  its  most  general  defini¬ 
tion  a  model  is  "a  representation  of  a  system  which  can  be 
used  as  an  explanatory  device,  an  analysis  tool,  a  design 
assessor,  or  even  a  crystal  ball.”  (Pritsker,  1984) 

There  are  various  types  of  models,  including  physical 
(iconic),  graphical  (visual),  and  mathematical  models 


(Pritsker,  1984:2).  Mathematical  models  can  be  conveniently 
viewed  as  either  dynamic  (functions  of  time)  or  static 
(independent  of  time).  Dynamic  models  are  used  to  replicate 
system  characteristics  as  they  change  with  elapsing  time. 
This  is  more  commonly  referred  to  as  simulation.  Static 
models  represent  the  interrelations  between  characteristics 
of  a  system.  Usually  these  relationships  do  not  depend  on 
elapsing  time,  or  the  effect  of  time  is  small  enough  to  be 
negligible.  In  this  study,  static  models  are  referred  to  as 
analytical  models. 

The  type  of  model  one  selects  is  dependent  on  such  fac¬ 
tors  as  budget,  time  availability,  accuracy  needed,  flexi¬ 
bility  desired,  and  control  over  environmental  influences. 
For  instance,  a  physical  model  might  be  used  to  gather  ini¬ 
tial  aerodynamic  data  for  a  new  airfoil  design.  However, 
due  to  its  expense,  a  physical  model  would  be  totally  inap¬ 
propriate  to  analyze  the  impact  of  changes  to  an  interstate 
transportation  network.  Instead,  a  computer  simulation 
model  could  be  built  which  would  allow  easy  operation  and 
wide  flexibility  at  low  cost. 

In  addition,  a  model  should  describe  and  differentiate 
between  proposed  systems  while  predicting  the  performance  of 
each.  The  form  of  the  model  must  be  such  that  analysis 
techniques  can  be  used  to  answer  predetermined  questions, 
in  this  study,  one  such  question  is.  "What  are  the  trade¬ 
offs  that  can  be  made  between  the  number  and  types  of 


subsystems  and  what  effect  does  this  have  on  the  overall 


system  performance?”  Physical  and  graphical  models  are 
inadequate  to  answer  this  question.  Physical  models  are  too 
expensive  to  build  for  every  possible  alternative  satellite 
servicing  system  (SSS),  and  graphical  models  do  not  allow 
any  flexibility  in  controlling  the  environment  or  in  varying 
the  model  attributes.  Mathematical  (analytical  or  simula¬ 
tion)  models,  however,  do  have  the  flexibility  and  cost 
effectiveness  that  is  needed  for  this  study. 

The  system  model  should  provide  system  performances 
that  are  measured  in  terms  familiar  to  the  decision  maker, 
so  that  he  can  understand  the  merits  of  each  system.  A 
large  list  of  possible  SSS  performance  measures  is  presented 
in  section  3.2.3.  Both  the  analytical  and  simulation  type 
models  can  be  used  to  measure  these  attributes.  For  this 
study,  analytical  models  were  chosen  so  that  the  static  or 
time-independent  behavior  of  the  solution  could  be  investi¬ 


i  * 

s 


- 


gated . 


Mathematical  optimization  techniques,  using  digital 
computers  to  manipulate  analytical  models,  provide  an  effi¬ 
cient  way  to  generate  sets  of  optimal  system  realizations. 
For  the  problem  of  selecting  the  best  satellite  servicing 
architecture,  multiple  objective  optimization  theory  (MOOT) 
techniques  can  be  used.  Chapter  V  contains  a  detailed 
explanation  of  MOOT  techniques  applied  to  this  problem. 

MOOT  techniques  are  designed  to  analyze  problems  with 
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conflicting  objectives.  If  these  objectives  did  not  con¬ 
flict.  the  problem  solution  would  reduce  to  a  scalar  optimi¬ 
zation  problem  yielding  a  single  optimal  answer.  In  select¬ 
ing  a  SSS  the  performance  measures  are  indeed  conflicting, 
for  instance,  to  achieve  a  desired  increase  in  mass 
delivered  to  orbit,  an  undesirable  increase  in  system  costs 
occurs . 


To  use  MOOT  techniques,  the  analytical  model  equations 
are  cast  into  statespace  form.  In  this  form,  the  charac¬ 
teristics  that  describe  the  system  are  called  state  vari¬ 


ables,  and  the  measures  of  system  performance  are  called 
performance  indices.  A  more  detailed  description  of  the 
statespace  form  is  presented  in  section  4.3.1. 


2.5  Systems  Analysis  Ste 


During  this  step  of  the  methodology,  the  candidate  sys¬ 


tem  models  are  analyzed  to  yield  optimal  engineering  solu¬ 
tions.  This  analysis  consists  of  two  parts:  generation  of 
the  members  of  the  \DSS,  and  validation  of  those  results. 
MOOT  techniques  are  used  to  generate  the  non-domi nated  solu¬ 
tions  for  this  study.  The  resultant  NDSS  is  then  analyzed 
to  determine  the  validity  of  the  models  and  the  results. 


For  the  problem  of  selecting  an  optimal  satellite  ser¬ 
vicing  system,  multiple  objective  optimization  theory  tech¬ 
niques  were  found  to  be  the  most  helpful  tool  lor  analysis. 
Using  MOOT,  an  optimizer  algorithm,  PKOCK S ,  is  used  to 
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recursively  vary  the  states  of  the  model  over  the  design 
space  to  produce  a  trial  solution.  This  trial  solution  is 
then  compared  against  the  members  in  the  non-domi nated  solu¬ 
tion  set.  If  the  trial  solution  is  not  dominated  by  another 
solution,  it  is  added  to  the  MOSS.  Eventually  a  set  of 
non-dominated  solutions  is  created  that  covers  the  design 
space  for  each  modeled  system. 

Once  an  NDSS  is  generated,  the  validity  of  the  solu¬ 
tions  must  be  confirmed.  Sensitivity  analysis  is  one  of  the 
most  powerful  methods  used  for  checking  the  validity  of  the 
system  models  and  solutions.  By  analyzing  the  solutions  in 
the  NDSS,  the  analyst  can  determine  potential  problems  with 
the  model  or  the  optimizer  algorithm.  Identified  problems 
are  corrected  and  the  entire  process  is  then  repeated.  This 
iterative  approach  permits  early  identification  of  flaws  in 
the  model  or  in  the  optimizer,  enabling  better  solutions 
with  each  iteration.  However,  there  will  always  be  a  certain 
amount  of  error  or  uncertainty  associated  with  the  solu¬ 
tions.  since  a  model  cannot  perfectly  duplicate  the  real 
wor Id . 

During  the  validation  step,  the  analyst  looks  not  only 
for  the  parameters  to  which  the  solutions  are  sensitive,  but 
also  for  the  solutions  which  are  sensitive  to  changes  in  the 
parameters.  Conversely,  he  also  looks  for  robust  solutions, 
or  solutions  which  are  relatively  insensitive  to  changes. 

The  decision  maker  can  then  use  this  information  to  select  a 


solution  that  is  appropriate  for  his  needs. 


In  Chapter  V, 


the  process  of  generating  an  NDSS  and  validating  the  mode) 
and  solution  set  are  demonstrated . 

2 . 6  Solution  Ranking  and  Selection  Step  (Decision  roak in g ) 

This  step,  along  with  the  design  of  the  value  system, 
embodies  the  second  phase  of  the  SE  approach.  Alternative 
system  descriptions  have  been  modeled,  the  models  have  been 
validated  and  analyzed,  and  a  set  of  nondominated  "equal ly- 
optimal”  solutions  have  been  found.  Now  it  is  the  responsi¬ 
bility  of  the  decision  maker  to  select  one  solution  for 
imp  1 ementat ion . 

Each  solution  in  the  NDSS  represents  a  different  system 
realization  (i.e.  size,  shape,  number)  for  a  particular 
overall  system  architecture.  Consider  as  a  candidate  archi¬ 
tecture  a  system  consisting  of  some  combination  of  space 
shuttles,  space  bases,  and  orbital  servicing  vehicles.  Each 
solution  in  the  NDSS  represents  a  specific  description  of 
that  architecture,  and  is  an  optimal  realization  in  that  it 
cannot  outperform  any  of  the  other  realizations  in  all 
areas.  However,  with  all  other  performances  being  equal,  one 
system  description  may  cost  more  for  operations,  or  one  may 
have  higher  reliability.  Consequently,  a  decision  maker  will 
likely  have  more  preference  for  one  solution  in  the  set  over 
the  others.  The  choice  of  solution  belongs  to  the  decision 
maker.  The  SE  approach,  then,  allows  a  supporting  engineer- 
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ing  organization  to  provide  not  the  solution,  but  a  choice 

of  solutions  for  consideration  by  the  decision  maker. 

Selection  of  a  solution  is  described  by  UeNeufville  and 

Stafford  (1971:12)  to  be 

”by  definition,  not  a  technical  problem  alone. 

The  analysts’  role  is  precisely  that  of  helping 
the  decision  process  by  removing  as  many  of  the 
technical  uncertainties  as  possible  ...  systems 
analysis  is  fundamentally  an  attempt  to  define 
issues  and  alternatives  for  the  decision  maker  and 
then  to  provide  him  with  the  information  relevant 
to  his  choice . ” 

The  value  system  is  simply  a  mechanism  that  captures 
the  decision  maker’s  preferences  for  incorporation  into  the 
solution  process.  The  decision  maker's  utility  for  the  per¬ 
formance  measures  is  multiplied  by  the  weighting  preferences 
of  the  objectives  in  the  hierarchy  tree  and  summed.  This 
yields  a  single  figure  of  merit  which  embodies  the  DM ’ s 
preference  for  each  solution  in  the  NDSS.  The  different 
solutions  in  the  NDSS  can  then  be  rank-ordered  by  their 
associated  figures  of  merit.  This  is  described  in  more 
detail  and  demonstrated  in  Chapter  111.  It  is  also  helpful 
for  a  decision  maker  to  know  how  sensitive  the  solution 
ranking  is  to  changes  in  his  preference  weightings.  A 
robust  solution  which  may  not  have  been  ranked  the  highest 
may  be  a  more  advantageous  selection,  especially  if  there  is 
uncertainty  in  some  of  the  system  parameters.  Sensitivity 
analysis  of  an  NDSS  is  described  in  Chapter  VI. 
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Planning  for  action  is  directly  tied  in  with  decision 
making.  In  this  step  the  analyst  examines  the  progress  tak¬ 
ing  place  in  the  solution  process,  and  decides  what  refine¬ 
ments  are  needed  and  to  what  degree.  Since  the  same  seven 
steps  are  repeated  over  and  over,  the  action  taken  here  may 
vary  with  each  iteration.  Early  in  the  design,  the  action 
taken  is  usually  to  continue  with  greater  detail  through  a 
new  iteration,  incorporating  the  information  gathered  and 
lessons  learned.  The  new  iteration  should  correct  areas  of 
uncertainty  that  were  uncovered,  while  continually  working 
towards  a  better  answer.  After  the  process  has  converged  to 
a  satisfactory  set  of  solutions,  the  analyst  may  use  this 
step  to  plan  how  to  communicate  the  results  to  the  decision 
maker(s).  Once  the  decision  maker  has  the  results,  his 
decisions  will  likely  drive  future  actions  on  the  project, 
be  that  implementation  or  shelving  of  the  project. 


2 . 8  Summer? 


This  chapter  has  explained  in  general  terms  the  metho¬ 
dology  that  is  used  in  this  study.  The  methodology  is 
divided  into  two  phases,  to  separate  the  engineering  design 
portion  from  the  preference- 1 aden  and  therefore  volatile 
second  phase. 


The  next  chapter  describes  why  the  second  phase  is  a 
necessary  part  of  a  methodology  for  solving  a  complex 
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problem.  It  covers  the  theory  and  application  for  develop¬ 


ing  a  value  system  for  any  decision  maker. 

The  remaining  chapters  explain  the  detailed  application 
of  the  rest  of  the  methodology  as  applied  to  the  problem  of 
selecting  an  optimal  satellite  servicing  system. 


111.  Value  System  Development 


3 . 1  Overv iew 

The  problem  of  selecting  a  satellite  servicing  archi¬ 
tecture  is  multi-faceted  and  involves  many  tradeoffs  among 
the  problem  objectives.  Because  some  of  these  tradeoffs 
depend  on  the  preferences  of  the  decision  maker(s)  (DM) 
involved,  it  is  necessary  to  include  the  decision  maker's 
values  (preferences)  in  the  solution  process.  The  mechanism 
that  does  this  is  termed  the  value  system. 

These  preferences  are  not  normally  used  until  a  set  of 
candidate  solutions  is  generated,  which  is  why  the  value 
system  is  the  second  phase  of  the  systems  engineering  (SR) 
approach.  However,  to  facilitate  a  better  understanding  of 
the  role  of  a  value  system  in  the  methodology,  this  chapter 
precedes  the  discussion  of  most  of  the  steps  in  the  first 
phase . 


Every  decision  maker  has  a  unique  value  system,  which 
is  simply  a  formal  mathematical  representation  of  his 
preferences.  If  certain  axioms  are  met.  a  mapping  of  those 
preferences  to  a  value  scale  can  be  accomplished.  Multi¬ 
attribute  utility  theory  (MAUT)  is  the  theoretical  framework 
that  is  used  to  create  this  mapping.  This  chapter  will  lead 
the  reader  from  a  development  of  MAUT  through  the  calcula¬ 
tion  of  figures  of  merit  for  the  solutions  in  the  non- 
dominated  solution  set  (NDSS). 


The  first  section  in  this  chapter  presents  an  introduc¬ 
tion  to  the  value  system,  and  develops  the  theoretical 


framework  of  mu  1 1 i -attr i bute  utility  theory.  An  analyst 
must  understand  the  appropriate  theory  applicable  to  his 
problem  in  order  to  begin  to  design  the  value  system.  Sec¬ 


tion  3.2  describes  the  hierarchy  approach,  which  is  a  useful 
way  to  break  a  problem  into  meaningful  parts  for  analysis. 
Section  3.3  presents  a  technique  for  capturing  a  decision 


maker’s  preferences  to  be  used  for  weighting  a  problem’s 
objectives.  Section  3.4  investigates  the  utility  or  ’’value” 
that  a  decision  maker  associates  with  the  units  of  measure 
for  each  performance  index.  In  section  3.5.  the  hierarchy 
approach,  weighted  objectives,  and  performance  ’’values”  are 
all  combined  to  determine  a  scalar  figure  of  merit.  This 
figure  of  merit  represents  the  preference  a  decision  maker 
has  for  a  particular  solution  in  the  non-dom inated  solution 
set  (NDSS).  The  solutions  in  the  NDSS  may  then  be  rank- 
ordered  by  their  figures  of  merit  to  yield  a  set  of  optimal 
solutions  listed  in  preferred  order  (for  a  particular  0(1). 
Ranking  of  the  optimal  candidate  solutions  is  demonstrated 
in  Chapter  VI,  Decision  Making.  Section  3.6  presents  a  two 
page-summary  that  recaps  the  basic  ideas  of  this  chapter. 


3.1.1  Introduction  to  the  Value  System.  A  mu  1 1 i -ob ject i ve 
problem  like  this  one  can  be  characterized  by  a  feasible 
region  F  that  satisfies  the  problem  constraints,  and  by  an 


overall  objective  function,  Z,  that  can  be  partitioned  into 
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measurable  ojective  functions,  z.t  where 

z  =  f (Zj(X) ,Z2(X) . Zn(X))  (3.1) 

(Goicoechea  et  al,  1982:19).  For  this  study.  Z  represents 
the  overall  objective  of  selecting  an  appropriate  satellite 
servicing  system.  This  overall  objective  is  a  function  of 
many  other  objectives,  such  as  the  desire  to  minimize  costs 
and  maximize  performance.  The  vector  X  i s  a  set  of  state 
variables  that  uniquely  describes  each  candidate  solution. 

One  way  of  physically  representing  this  overall  objective, 

Z.  as  a  function  of  its  subobjectives.  Z^t  is  in  the  form  of 
a  "tree,”  as  shown  in  Figure  3.1.  (The  concept  of  a  hierar¬ 
chy  tree  will  be  covered  in  greater  detail  in  Section  3.2.) 
Each  level  of  the  tree  completely  describes  the  overall 
objective,  but  at  a  different  level  of  detail.  At  the 
lowest  level  of  the  tree  structure,  the  objectives  can  be 
quantifiably  measured  in  some  way  by  a  set  of  descriptors. 
These  descriptors  are  termed  "attributes,"  or  for  the  pui — 
poses  of  this  study,  "performance  indices”  1P1).  The  terms 
attributes  and  performance  indices  will  be  used  interchange¬ 
ably  in  this  study.  The  overall  objective,  Z,  can  then  be 
written  as  a  function  of  these  performance  indices. 
as  shown  in  equation  3.1.  In  other  words,  the  accomplishment. 


of  the  overall  objective  can  be  completely  described  in 
terms  of  the  measures  of  the  performance  indices  (which 
represent  the  measure  of  accomplishment  of  the  objectives  on 


the  bottom  level  of  the  tree) 


m 


figure  3.1  Hierarchy  of  Objectives  (Chankong  and  Haimes,  1983:9) 


Each  candidate  solution,  which  is  described  by  the  X_ 
state  variables,  will  have  an  associated  level  of  accom¬ 
plishment  for  each  of  these  performance  indices.  Z.(x>.  In 
a  sense,  the  levels  of  the  set  of  performance  indices 
describes  each  alternative  solution.  Usually,  calculation  or 
these  performance  indices  is  by  straight-forward  determinis¬ 
tic  methods.  Sometimes,  however,  the  information  related  to 
a  particular  index  is  unknown  or  uncertain.  In  these  cases, 
a  probability  distribution  is  used  to  represent  the  perfor¬ 
mance  index.  If  none  of  the  Pi  describing  the  solution 
involves  uncertainty,  the  alternative  solution  is  termed  a 
’’certain  alternative."  If  there  is  uncertainty  associated 
with  the  measure  of  any  of  the  PI,  the  associated  solution 
is  termed  an  "uncertain  alternative.” 
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in  single-objective  problems  it  is  possible  to  find  a 
single  optimal  solution.  However,  for  a  mu  1 1 i -object i ve 
problem,  the  solution  is  usually  in  the  form  of  a  set  of 
non -dominated  solutions  (NDSS)  which  is  a  subset  of  the 
feasible  region.  The  main  characteristic  of  the  non- 
dominated  set  of  solutions  is  that  for  each  solution  outside 
this  set  (but  still  within  the  feasible  region),  there  is  a 
non -dom i na ted  solution  for  which  all  performance  indices  are 
unchanged  or  improved  and  at  least  one  which  is  strictly 
improved  (Goicoechea  et  al.  1982:19).  A  more  formal 
mathematical  description  of  the  NDSS  may  be  found  in  Goicoe¬ 
chea.  See  the  analysis  part  of  this  report.  Section  V,  for 
a  detailed  discussion  of  the  NDSS. 

The  set  of  non-don i nated  solutions  is  determined  during 
the  first  phase  of  the  SE  approach  without  considering  the 
preferences  of  the  decision  maker.  Consequently  the  NDSS  is 
independent  of  DM  preferences,  and  the  first  phase  of  the 
approach  need  not  be  reaccomplished  if  the  DM  preferences 
change.  In  order  to  select  a  best  or  most  acceptable  solu¬ 
tion  for  a  particular  DM,  out  of  this  set  of  optimal  solu¬ 
tions.  it  is  necessary  to  include  the  value  judgements  of 
that  decision  maker.  This  is  an  important  point.  Every 
alternative  in  the  set  of  non-dominated  solutions  is.  from 
an  engineering  viewpoint,  an  acceptable  "optimal”  solution. 
Because  each  decision  maker  may  prefer  certain  performance 
indices  over  others,  he  will  probably  prefer  one  solution  in 


the  NDSS  over  the  others.  These  preferences  (based  on  the 


decision  maker’s  intuition  and  experience)  are  described  by 

his  value  structure.  By  incorporating  the  decision  maker's 

value  structure  into  the  problem,  the  alternatives  in  the 

NDSS  may  be  rank-ordered  to  determine  which  is  the  best- 

compromise  solution  for  his  purposes.  In  the  ’’Theory  of  the 

Displaced  Ideal”.  Zeleny  points  out: 

If  one  obtains  an  accurate  measurement  of  the  net 
attractiveness  (or  utility)  of  each  available 
alternative,  one  can  predict  with  reasonable  accu¬ 
racy  that  a  person  will  choose  the  alternative 
which  is  ’most  attractive.’  So,  the  problem  of 
prediction  of  choice  becomes  the  technical  problem 
of  measurement  and  mechanical  search.  Furthermore, 
if  the  alternatives  are  complex  and  multi- 
attributed.  then  the  measurement  of  utility  could 
be  too  difficult  to  be  practical.  The  real  ques¬ 
tion  concerns  the  process  by  which  the  decision 
maker  structures  the  problem,  creates  and  evalu¬ 
ates  the  alternatives,  identifies  relevant  cri¬ 
teria.  adjusts  their  priorities  and  processes 
inf ormation . . . . I t  is  important  to  realize  that 
whenever  we  face  a  single  aggregate  measure,  there 
is  no  decision  making  involved.  The  decision  is 
implicit  in  the  measurement  and  it  is  made  by  the 
search. ...It  is  only  when  facing  multiple  attri¬ 
butes,  objectives,  criteria,  functions,  etc.,  that 
we  can  talk  about  decision  making  and  its  theory 
(Zeleny,  1975:157). 


3.1.2  Discussion  of  Utility  Theory.  Involved  in  any  deci¬ 
sion  making  process  is  the  task  of  constructing  a  preference 
order,  so  that  alternatives  may  be  ranked  and  the  final 
choice  may  be  selected  (Chankong  and  llaimes.  19B3:b2).  Util¬ 
ity  theory  assumes  that  an  individual  can  choose  among 
alternatives  and  pick  the  one  choice  from  which  he  derives 
the  most  satisfaction.  Relative  to  the  vector  of  objectives. 


it  is  assumed  that  all  information  pertaining  to  the  various 


levels  of  the  objectives  can  be  captured  by  an  individual’s 
utility  function.  In  essence,  an  individual's  utility  func¬ 
tion  is  a  formal,  mathematical  representation  of  his  prefer¬ 
ence  structure  (Goicoechea  et  al.  1982:26). 


An  individual’s  preferences  must  satisfy  certain  condi¬ 
tions  in  order  to  be  representable  by  a  utility  function. 

The  number  of  conditions  varies  from  four  to  six  depending 
on  how  they  are  presented  (Sage.  1977:329).  Goicoechea 
demonstrates  these  conditions  in  the  form  of  the  four  axioms 
below,  as  derived  by  Markowitz.  If  an  individual  conforms  to 
these  axioms,  a  utility  function  can  be  constructed  that 
will  express  his  preferences  for  outcomes  involving  cer¬ 
tainty  or  uncertainty  (Goicoechea  et  al.  1982:26).  Only  the 
first  two  axioms  must  be  satisfied  for  alternatives  involv¬ 
ing  certainty.  The  axioms  are  (Markowitz.  1959): 

1.  For  two  alternatives.  A^  and  A2<  one  of  the 

following  must  be  true:  the  individual  prefers  A^ 

to  A2 ,  prefers  A2  to  A^,  or  is  indifferent  between 
them. 

2.  The  individual’s  evaluation  of  alternatives  is 

transitive:  if  he  prefers  to  A2 ,  and  A2  to  A3 , 

then  he  prefers  A ^  to  A3. 

3.  Assume  that  A^  is  preferred  to  A2,  and  A2  to 
a3 .  then  there  exists  some  probability  p.  0<p<l, 
that  the  individual  is  indifferent  between  outcome 
A2  with  certainty,  or  getting  A|  with  probability 
p  and  Ag  with  probability  (1-p).  In  other  words, 
there  exists  a  certainty  equivalent  to  any  gamble. 

4  Assuming  an  individual  is  indifferent  between 
two  choices,  A.  and  A2 ,  and  if  A3  is  any  third 
alternative,  tnen  he  will  be  indifferent  between 
the  following  two  gambles:  Gamble  1  offers  a  pro¬ 
bability  p  of  receiving  A.  and  a  probability  (1-p) 
of  receiving  A~f  and  Gamble  2  offers  a  probability 


p  of  receiving  and  a  probability  (1-p)  of 
rece iving  A^, 


Once  the  utility  function  is  determined,  it  can  be  used 


to  order  the  set  of  non-dominated  solutions.  The  non- 


doroinated  solution  which  yields  the  highest  utility  will  be 


the  best-compromise  solution  for  the  problem  for  that  deci 


sion  maker  (Goicoechea  et  al,  1982:27). 


3. 1.2.1  Value  functions  and  Utility  functions.  All  prob¬ 


lems  involving  decision  theory  can  be  separated  into  one  of 


four  types  as  shown  in  Figure  3.2.  Problems  with  ’’certain 


alternatives"  are  described  by  value  theory  (also  called 


deterministic  utility  theory)  and  the  associated  utilities 


are  represented  by  value  functions.  To  emphasize  the 


differences,  problems  involving  uncertainty  or  random 


occurrences  (uncertain  alternatives)  are  described  by  util¬ 


ity  theory  (also  called  expected  utility  theory)  and  are 


represented  by  utility  functions.  figure  3.3  shows  the 


methodology  appropriate  to  each  type  problem.  All  future 


references  to  general  mu  1 1 i -att r i bute  utility  theory  (value 


theory  and  utility  theory)  will  use  the  term  MAUT  (multi¬ 


attribute  utility  theory)  to  include  cases  under  both  cer¬ 


tainty  and  uncertainty.  The  more  descriptive  individual  ter¬ 


minology  will  be  used  when  appropriate.  While  there  are 


many  commonalities  in  the  basis  for  MAUT  under  certainty  and 


uncertainty,  the  main  differences  occur  in  the  manner  in 


which  the  preferences  are  solicited  to  determine  the  value 
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Figure  3.3  Decision  Problem  Methodology  (reldman  and  Rowell,  1985) 

function  or  utility  function.  Since  this  report  details  a 
methodology  involving  mu  1 1 i -a tt r i bute  decision  theory  with 
certain  alternatives,  mu  1 1 i -attr i bute  value  theory  and 
determination  of  value  functions  will  be  discussed  pri¬ 
marily. 


There  are  two  important  functional  forms  of  a  multi- 
attribute  utility  function  (certainty  or  uncertainty)  in 
MAUT. 

One  is  the  additive  form  described  by 

U(_X_>=  Z  K :  U ,  ( X ;  )  (3.2) 

i  =  1 

where 

U(_X)  is  normalized:  0  <  U(X)  <  1 
D;  is  the  single  attribute  function  of  X-  normalized: 

o  <  Vxi>  -<  1 

the  scaling  constants  are  positive  and  sura  to  1. 


An  example  of  a  three-attribute  additive  value  function  is 
the  f o 1  lowing: 

V<X1-X2’X3)  =  KjVjUj)  +  K2V2(X2)  K3V3(X3)  (3.3) 


The  other  important  functional  form  is  the  multiplicative  form 


described  by 


n  n  n 

UOO=  I  K.U;(X;)  +  K  I  I  KiKiUi(Xi  )Ui(Xi) 
i = i  11  i=l  j>l  J  J  J 


2  n  n  n 

K  II  I  K  .  K  ;K  1  (J  :  (  Xj  )l)  j  (  X  •  )ll  1  (  X  l  ) 
i  =  1  j>l  i>j  J  i  l  j  j 


n~  1  n 

+  • • •  +  K  n  K.U(X:  )  (3.4) 

i  “  1 


where 


U ( X >  is  normalized:  0  <  U(X)  <  1 


Uj(Xj)  is  normalized 


is  positive  and  less  than  1 


K,  the  coupling  coefficient  solves  1  K  =  n  (1  +  KK.) 

i  =  1  1 


An  example  of  a  of  multiplicative  value  function  is  the 
f o 1  lowing: 

V(X1*X2’X3)  =  K1V1(X1)  f  K2V2(X2)  »  x3 V3 ( X3 ) 

+  KK1k2V1(Xj)V2(X2)  ♦  KKjK3V1(Xj )v3(x3) 

+  KK2K3V2(X2)V3(X3> 


+  K  K12K3V1(X1)V2(X2>V3(X3> 


(3.5) 


(Feldman  and  Rowell,  1985;  Goicoechea  et  al,  1982:28,124) 
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3. 1.2. 2  Independence  Conditions.  The  appropriate  type  of 
utility  function  to  use  is  dependent  not  only  on  the  problem 
to  be  solved,  but  also  on  the  determination  by  the  decision 
maker  that  the  problem  objectives  satisfy  certain  indepen¬ 
dence  conditions.  These  conditions  will  now  be  discussed. 

The  pair  of  attributes  (X^,X2)  out  of  an  n-tuple  of 
attributes  < Xj , X2 » • • • »Xn )  is  preferentially  independent 

( Pr 1 ) *  of  its  complementary  attributes  (X3 . Xn>  it 

preferences  among  (X^fX2)  with  the  complement  fixed  do 
not  depend  on  the  level  at  which  (X^ . Xn>  are  fixed. 

As  an  example  suppose  that  three  subobjectives  for 
selecting  a  satellite  servicing  system  are 

SCC  -  satisfies  congressional  concerns 
MA  -  accomplishes  the  mission 
ULR  -  utilizes  limited  resources  optimally 


The  value  tradeoffs  between  satisfying  congressional 
concerns  and  accomplishing  the  mission  may  not  depend  on  how 
well  the  system  utilizes  the  limited  resources  that  are 


available.  On  a  value  scale  of  0  to  1,  assume  ULR  is  set  at 
a  value  of  .2.  If  the  preference  between  SCC  and  MA  does 
not  change  when  ULR  is  changed  to  .7  or  any  other  value, 
then  {SCC.MA}  is  preferentially  independent  of  {ULR}. 


*  In  the  literature,  "preferentially  independent"  is 
commonly  abbreviated  "PI."  In  this  thesis.  Pi 
represents  performance  index.  To  avoid  reader  confu¬ 
sion.  PrI  is  used  for  preferentially  independent. 


if  each  pair  of  attributes  is  preferentially  indepen¬ 
dent  of  its  complement,  the  attributes  are  pairwise 
preferentially  independent  (  P  P 1  )  . 

In  our  example  above,  the  same  type  of  comparisons 
would  be  done  for  each  possible  combination  of  pairs.  If  in 
addition  to  {SCC.MA}  being  preferentially  independent  of 
{ILR>  (or  {SCC .  MA>  Prl  (ULR>),  if  { MA  ,  liLR}  Prl  {SCO.  and 
{SCC.ULR}  Prl  {MA}  ,  then  these  attributes  are  pairwise  pre¬ 
ferentially  independent. 

The  attributes  . Xn  are  mutually  preferentially 

independent  (MP1)  if  every  subset  Y  of  these  attributes 
is  preferentially  independent  of  its  complementary  set 
(Keeney  and  Raiffa.  197b: ill). 

For  three  or  more  attributes,  pairwise  preferential 
independence  is  equivalent  to  mutual  preferential  indepen¬ 
dence  (Keeney  and  Raiffa.  1976:114).  MPI  is  a  necessary  and 
sufficient  condition  for  an  additive  value  function  (Feldman 
and  Rowell.  1985).  The  necessary  and  sufficient  condition 
for  use  of  a  multiplicative  value  function  is  satisfaction 
of  mutual  weak  difference  independence  (MWD1). 

The  attributes  are  MWD1  if  for  any  one  of  the  attri¬ 
butes,  X.,  it  can  be  shown: 

1.  Xj  is  weak  difference  independent  (WDI)  of  its  com¬ 
plementary  set  { X  j . X i  _  i  •  X  j  +  | . Xn> 


If  each  pair  of  attributes  is  preferentially  indepen¬ 
dent  of  its  comp  1 eroent .  the  attributes  are  pairwise 
preferentially  independent  (PP1). 

In  our  example  above,  the  same  type  of  comparisons 
would  be  done  for  each  possible  combination  of  pairs.  If  in 
addition  to  {SCC.MA}  being  preferentially  independent  of 
<liLR>  (or  {SCC ,  MA>  PrI  {ULR}),  if  {MA,ULR>  Prl  {SCC>.  and 
{SCC.ULR}  Prl  {MA>,  then  these  attributes  are  pairwise  pre¬ 
ferentially  independent. 

The  attributes  . Xn  are  mutually  preferentially 

independent  (MPl)  if  every  subset  Y  of  these  attributes 
is  preferentially  independent  of  its  complementary  set 
(Keeney  and  Raiffa,  1976:111). 

For  three  or  more  attributes,  pairwise  preferential 
independence  is  equivalent  to  mutual  preferential  indepen¬ 
dence  (Keeney  and  Raiffa,  1976:114).  MPI  is  a  necessary  and 
sufficient  condition  for  an  additive  value  function  (Feldman 
and  Rowell,  1985).  The  necessary  and  sufficient  condition 
for  use  of  a  multiplicative  value  function  is  satisfaction 
of  mutual  weak  difference  independence  (MWDI). 

The  attributes  are  MWD 1  if  for  any  one  of  the  attri¬ 
butes,  X.,  it  can  be  shown: 

X.  is  weak  difference  independent  (WDI)  of  its  com¬ 
plementary  set  <Xt . X  i  _  j  .  X  i  + 1 . Xn> 
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2.  <X4 . Xj>  is  preferentially  independent  of  its  com¬ 
plementary  set  <XX . xi-i>*i  +  i . xj-l’xj  +  l . xn>  * 

where  i  is  not  equal  to  j. 


The  test  for  weak  difference  independence  will  be  explained 
shortly.  MWDI  requires  that  a  total  of  n  tests  be  performed 
--  the  first  test  need  be  done  only  once  for  only  one  attri¬ 
bute.  and  the  second  test  need  be  done  n~l  times  with  that 
same  attribute  in  combination  with  all  other  attributes 
(Feldman  and  Rowell,  1985).  Preferential  independence,  used 
in  the  second  test,  was  demonstrated  in  an  example  earlier. 


The  first  test,  satisfaction  of  weak  difference 
independence,  can  be  best  explained  in  an  example.  Assume 
there  are  n  attributes.  Take  one  attribute  out  of  the  set, 
say  Xj ,  and  set  its  complementary  set  <X2»...,Xn)  to  its 
lowest  level.  Assume  six  points  (including  the  endpoints) 
are  known  on  the  value  curve  for  XJf  as  in  Figure  3.4. 


Figure  3.4  WDI  Test  (Feldman  and  Rowell,  1985) 


There  is  a  positive  value  difference  relationship  esta¬ 
blished  between  (V(b)-V(a))  and  (V(d)-V(c)),  of  .175  and  .1 
respectively.  If  the  complementary  set  is  then  changed  to 
its  highest  level,  the  resulting  value  curve  for  the  same 
four  points  should  be  examined.  If  (V(b)-V(a))  is  still 
greater  than  or  equal  to  (V(d)-V(c)),  then  XI  is  WDI  of  its 
complementary  set,  and  the  first  test  is  satisfied  (Feldman 
and  Rowell,  1985).  This  positive  value  difference  relation 
ship  must  hold  for  any  arbitrary  four  points  selected.  In 
other  words,  the  relationship  in  the  above  example  also 


holds  for  the  differences  (V(c)-V(a))  greater  than  or  equal 


to  (V(d)-V(b)).  In  essence,  the  two  value  curves  condi¬ 
tioned  by  different  levels  of  the  complementary  set,  must  be 
very  similar  to  each  other.  The  interested  reader  is 
referred  to  (Chankong  and  Haimes.  1983:81-88)  for  additional 
discussion  of  MWDl.  Utility  theory  (uncertainty)  involves 
similar  independence  conditions  and  the  interested  reader 
will  find  an  extensive  discussion  of  them  in  (Chankong  and 
Haimes.  1983:  88-109),  (Keeney  and  Raiffa,  1976:Ch  6).  or 
(Sage.  1977:328-346). 


The  value  system  design  described  in  this  paper  uses  an 
additive  value  structure  with  ’’certain”  alternatives.  Satis¬ 
faction  of  mutual  preferential  independence  for  the  objec¬ 
tives  used  in  this  study  is  demonstrated  in  Appendix  A. 
Satisfying  MPi  guarantees  that  an  additive  value  function 
can  be  used.  The  remainder  of  this  paper  will  be  based  on 
this  additive  structure  using  value  functions.  In  summary, 
this  additive  value  structure  can  be  represented  by  equation 
3.2  or 


V(_X)  «  K1V1(X1  ) 


K2v2(X2> 


“nW 


(3.6) 


3. 1.2. 3  Value  Function  Shape.  Once  the  appropriate  struc¬ 
ture  (additive  or  multiplicative)  is  determined,  the  shape 
of  the  value  function  curve  must  be  identified  for  each  per¬ 
formance  index.  In  other  words,  the  actual  function  that 
represents  each  V . ^ ^  ^ 


in  equation  3.6  must  be  found.  There 


are  a  number  of  methods  available  in  the  literature  for 


determining  the  shape  of  the  value  function,  including  the 


lock-step  procedure,  midvalue  splitting  technique  (Keeney 


and  Raiffa,  1976:94-100),  and  the  analytic  hierarchy  process 


(Kamenetsky,  1982:702-712).  There  are  also  a  number  of  good 


software  packages  available  to  aid  in  this  task.  The  com¬ 


puter  program  MADAM  ( Mu  1 1 i -Attribute  Decision  Analysis 


Model)  is  one  such  program  that  may  be  used  to  define  the 


shape  of  the  single-attribute  value  f unct ions . V . ^ ^  ^  MADAM 


is  written  in  FORTRAN  V  and  is  an  interactive  prograi 


designed  to  test  for  tne  necessary  and  sufficient  conditions 


for  an  additive  value  function  and  to  evaluate  the  resulting 


value  function  if  these  conditions  are  met  (Dewispelare  and 


Stimpson,  1983).  An  extended  version  of  MADAM  (EMADAM)  is 


currently  implemented  on  the  CYBER  175  computer  system  at 


the  Air  Force  Institute  of  Technology  (Dewispelare,  1983). 


This  extended  version  includes  the  incorporation  of  utility 


concepts  to  allow  analysis  of  problems  involving  uncer¬ 


tainty.  Computer  code  for  this  program  is  available  by  con¬ 


tacting  Captain  Stuart  Kramer,  Department  of  Aeronautics  and 


Astronautics,  Air  Force  Institute  of  Technology,  Wright- 


Patterson  AFB,  Ohio,  45433. 


MADAM  uses  the  midvalue  splitting  technique  to  define 


points  on  the  single-attribute  value  curve  and  then  allows 


one  of  five  functions  to  be  fit  to  the  points  generated. 


Manuals  for  MADAM  are  available  through  the  Defense  Technol 
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ogy  Information  Center  (Stimpson,  1983).  Using  the  midvalue 


splitting  technique  to  determine  the  shape  of  the  value 
function  curve  will  be  demonstrated  in  detail  in  section 
3.4.2. 

3 . 2  Hierarchy  of  Objectives.  Hierarchy  Approach  (Chankong 
and  Haimes,  1983;  DeWispelare,  1983;  Saaty ,  1980 ) 

The  previous  section  provided  the  necessary  theoretical 
framework  for  determining  a  decision  maker’s  preferences. 

In  order  to  use  this  framework  it  is  necessary  to  create  an 
ordering  of  the  set  of  problem  objectives.  This  section 
will  explain  how  this  hierarchy  of  objectives  is  constructed 
and  used  in  the  value  system. 

3.2.1  Objectives  ♦  An  objective  is  a  condition  about  the 
desired  state  of  the  system  being  considered,  giving  the 
general  direction  to  which  effort  will  be  exerted.  In  the 
multiple-attribute  decision  problem,  there  will  be  several 
conditions  expressing  the  decision  maker's  desired  state  of 
the  system.  An  objective  is  not  the  same  as  a  goal;  a  goal 
is  a  specific  level  of  some  performance  measure  which  is  or 
is  not  achieved.  An  objective  designates  no  specific  level, 
but  indicates  direction.  Objectives  are  directions  toward 
which  the  system  should  be  proceeding  and  they  are  standards 
against  which  the  quality  or  performance  of  an  alternative 
may  be  evaluated. 

A  well-defined  set  of  objectives  often  exhibits  a 
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hierarchial  structure,  as  illustrated  in  Figure  3.1.  Moving 


up  through  the  hierarchy,  the  subobjectives  should  indicate 
the  means  to  an  end;  the  end  is  indicated  by  a  parent  or 
overall  objective.  A  result  of  this  is  that  the  movement  up 
the  hierarchy  has  a  natural  stopping  point  at  the  parent  or 
overall  objective.  This  objective  should  give  the  overall 
reason  for  the  decision  maker's  interest  in  the  problem,  and 
often,  it  is  too  vague  for  operational  purposes.  Moving 
down  through  the  hierarchy’s  levels,  the  objectives  at  the 
lower  level  are  more  specific  and  more  operational  than 
those  in  the  higher  level.  These  lower  level  objectives  are 
viewed  as  the  means  to  achieving  the  higher  ends  represented 
by  the  parent  objective.  The  movement  down  through  the 
hierarchy  has  no  well  defined  stopping  point.  It  is  up  to 
the  decision  maker  to  determine  the  extent  of  available 
resources  and  take  a  practical  attitude  towards  the  amount 
of  detail  desired. 

Breaking  a  parent  objective  into  subobjectives  is 
called  "specification”.  Specification  allows  division  of 
the  objectives  into  subobjectives  with  increasing  amounts  of 
detail.  The  more  detailed  subobjectives  are  designed  to 
encompass  all  aspects  of  the  parent  objective.  At  each 
stage  of  specification,  the  group  of  subobjectives  should  be 
tested  to  decide  whether  or  not  some  of  the  subobjectives 
may  be  insignificant  relative  to  the  other.  If  any  are 
found  to  be  insignificant,  they  should  be  deleted. 
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3.2.2  Attributes.  To  use  the  hierarchial  structure,  a  set 


of  attributes  is  assigned  to  each  objective  in  the  lowest 
level.  The  attribute  set  provides  a  means  of  measuring  the 
degree  to  which  the  lowest-level  objectives  (and  therefore, 
indirectly,  all  the  objectives)  are  satisfied.  Each  attri¬ 
bute  should  be  comprehensive.  A  comprehensive  attribute 
clearly  shows  the  decision  maker  how  well  its  associated 
objective  is  achieved.  The  lowest-level  objectives  show  the 
degree  of  detail  to  be  used  in  the  decision  analysis,  and 
the  attribute  set  contains  at  least  one  attribute  to  measure 
each  of  the  lowest-level  objectives.  There  is  no  unique 
attribute  set  for  a  given  objective  hierarchy. 

There  are  three  kinds  of  attributes:  normal,  proxy,  and 
direct  preference  measures.  Normal  attributes  are  those 
attributes  which  directly  measure  their  associated  objec¬ 
tives.  Proxy  attributes  reflect  the  degree  to  which  the 
associated  objectives  are  met,  but  do  not  directly  measure 
the  objectives.  The  direct  preference  measure  attribute 
indicates  on  a  subjective  scale  of  worth  the  degree  to  which 
an  objective  is  met.  This  scale  is  dependent  upon  the  deci¬ 
sion  makers  preferences.  The  most  desirable  attribute  is 
the  normal  attribute,  since  it  involves  direct  measurement 
of  the  level  of  accomplishment  of  the  objective.  The  least 
desirable  attribute  is  the  direct  preference  measure, 
because  of  the  subjective  measures  involved.  Ail  efforts 
should  be  made  by  the  decision  maker  to  insure  that  each 
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attribute  does  measure  what  was  intended. 

There  are  several  desirable  properties  for  the  set  of 
attributes  as  a  whole.  The  attribute  set  should  be  opera¬ 
tional.  complete,  decomposable,  non-redundant ,  and  minimal. 
An  operational  attribute  is  descriptive,  easy  to  use.  and 
has  significance  to  the  decision  maker.  A  set  of  attributes 
can  be  termed  complete  if  the  decision  maker  is  satisfied 
that  there  are  enough  attributes  to  measure  the  level  of 
accomplishment  of  the  overall  objective.  Completeness  may 
be  indicated  when  the  lowest  level  of  objectives  in  the 
hierarchy  includes  all  areas  of  concern.  The  attribute  set 
should  also  be  decomposable,  implying  that  subsets  of  the 
whole  attribute  set  may  be  examined  separately  from  the  oth¬ 
ers.  to  check  for  the  different  kinds  of  independence 
described  in  section  3. 1.2. 2.  A  non-redundant  attribute 
does  not  allow  double-counting  of  consequences.  For 
instance,  if  two  attributes  used  to  describe  the  quality  of 
a  nation’s  health  are  "deaths  due  to  cancer"  and  "male 
deaths",  one  attribute  would  be  double-counting  the  males 
who  died  from  cancer.  Having  a  minimal  set  means  that  the 
attribute  set  is  kept  as  small  as  possible,  bounded  by  all 
of  the  preceding  properties. 

3.2.3  Hierarchy  Approach.  There  are  several  advantages  to 
using  the  hierarchial  approach.  The  hierarchial  structure 
as  shown  in  figure  3.1  enables  the  analyst  to  see  how 
changes  in  the  priorities  of  the  upper  levels  influence  the 
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priorities  of  the  lower  levels. 


Hierarchies  also  offer 


detailed  information  on  the  structure  and  function  of  a  '  vs~ 
tem  in  the  lower  levels,  while  providing  an  overview  of  t  i 
objectives  and  their  purposes  in  the  upper  levels.  The 
objectives  of  systems  developed  hierarchia 1 1 y  evolve  much 
more  efficiently  than  those  developed  in  other  ways.  The 
process  of  leading  the  analyst  gradually  through  greater 
amounts  of  detail  in  objective  development,  helps  eliminate 
misconceptions  of  subcomponent  relations  that  are  likely  to 
occur  if  the  final  level  of  detail  is  derived  directly. 

When  used,  hierarchies  enable  calculation  of  how  well  a  sys¬ 
tem  meets  the  objectives  presented.  The  degree  to  which  a 
system  meets  all  objectives  generally  changes  very  little 
when  objectives  within  the  hierarchy  are  varied  slightly. 
Also,  for  a  well  structured  hierarchy,  minimal  additions 
cause  minimal  influence  in  the  degree  that  a  system  meets 
a  1 1  ob ject i ves . 

To  determine  a  hierarchy,  Saaty  (Saaty,  1980:pl4) 
recommends  using  a  brainstorming  session  to  generate  all 
possible  elements.  Once  these  elements  have  been  generated 
they  can  be  functionally  located  at  various  levels  as 
appropriate.  The  functional  representation  of  a  system  in 
hierarchial  form  is  not  unique  to  a  particular  system,  but 
depends  upon  an  individual’s  concept  of  the  problem  situa¬ 
tion. 


Sage  uses  interpretive  structural  modeling  or  ISM  to 
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help  determine  the  appropriate  structural  relationships 
between  elements  of  a  system  (Sage.  1977:Ch  4).  Conse¬ 
quently.  ISM  could  be  used  to  establish  the  appropriate 
structure  for  a  hierarchy  tree.  A  discussion  of  ISM  may  be 
found  in  Section  4. 2. 3.1. 

A  hierarchy  of  objectives  developed  for  this  study  is 
shown  in  Figure  3.5.  it  consists  of  three  levels.  The 
overall  objective,  found  at  Level  1,  is  to  select  the  best 
satellite  servicing  system.  This  objective  is  accomplished 
when  the  Level  2  objectives  (satisfying  political  concerns, 
minimizing  cost,  and  maximizing  performance)  are  accom¬ 
plished.  Similarly  the  Level  2  objectives  depend  on  the 
Level  3  objectives. 

After  discussions  with  decision  makers  at  the  USAF 
Space  Division  (Green,  1985;  Lemon,  1985;  Sundberg,  1985; 
Wimberly,  1985;  Wittress,  1985;  Zersen,  1985)  a  more 
comprehensive  hierarchy  of  objectives  was  developed.  This 
new  hierarchy,  consisting  of  six  levels  and  40  objectives 
and  subobjectives,  is  shown  in  Figure  3.6.  A  detailed 
description  of  this  hierarchy  may  be  found  in  Appendix  B. 

To  facilitate  demonstration  of  this  methodology  using 
easily  measurable  attributes,  the  simplified  hierarchy  in 
Figure  3.7  was  developed.  Although  this  is  an  overly  sim¬ 
plified  set  of  objectives  for  this  problem,  it  will  be  much 
easier  for  the  reader  to  follow  application  of  this  metho- 
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Figure  3.5  Hierarchy  of  Objectives 


dology  using  it.  This  same  methodology  may  be  applied  to 


the  larger  hierarchy 


Comprehensive  Hierarchy  ot  Objectives 
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Figure  3.7  Simplified  Hierarchy  of  Objectives 


3 . 3  Capturing  a  Decision  Maker's  Weightings  of  Objectives 
(Crawford  and  Williams, _ 1985J 

Once  a  hierarchy  of  objectives  has  been  established,  it 
is  required  to  determine  the  preference  or  weighting  that  a 
decision  maker  credits  to  each  objective.  This  is  necessary 
to  apply  the  hierarchy  structure  as  described  in  section  3.1 
to  get  an  overall  figure  of  merit  for  each  system,  and 
finally  a  ranking  of  systems.  One  method  for  soliciting 
these  preferences  is  detailed  in  this  section. 


As  described  earlier,  an  objective  hierarchy  is  a  col¬ 
lection  of  objectives  grouped  according  to  levels  (see  Fig¬ 
ure  3.1).  Objectives  at  each  specific  level  of  the  hierar¬ 
chy  depend  upon  the  objectives  at  the  lower  levels.  An 
objective  at  any  level  in  the  hierarchy  may  be  ranked  by  a 
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ratio  scale,  relating  its  importance  relative  to  a  given 


objective  at  the  level  above  it.  It  is  then  possible  to 
construct  a  system  of  ratio  scales  which  yields  the  relative 
importance  (or  weighting)  of  any  objective  at  one  level,  to 
any  other  objective  in  a  higher  level. 

Several  ways  exist  to  construct  this  system  of  ratio 
scales.  Two  methods  commonly  used  are  the  geometric  mean 
approach,  and  the  Saaty  eigenvalue/eigenvector  approach. 

Due  to  the  complexity  in  calculating  the  consistency  ratio 
(to  be  explained  later)  for  the  geometric  mean  approach,  the 
Saaty  eigenvalue/eigenvector  method  will  be  used  and 
explained  for  this  study.  The  interested  reader  will  find 
an  excellent  discussion  of  the  geometric  mean  approach  in  a 
report  by  the  RAND  Corporation,  titled  ’’The  Analysis  of  Sub¬ 
jective  Judgement  Matrices”  (Crawford  and  Williams,  1985). 

3.3.1  E i gen va 1 ue/ Ei genvector  Approach.  Thomas  Saaty  of  the 
University  of  Pennsylvania  developed  a  method  for  estimating 
subjective  ratio  scales  using  pairwise  comparisons.  In  this 
method  the  analyst  has  the  decision  maker  perform  pairwise 
comparisons  between  the  objectives.  For  each  objective 
pair,  the  decision  maker  identifies  not  only  which  objec¬ 
tives  are  preferred,  but  also  to  what  degree  that  objective 
is  preferred  over  the  other.  A  preference  ratio  scale  is 
then  determined  for  the  objectives  based  upon  eigenvector 
analysis  of  a  matrix  of  pairwise  comparisons. 
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In  order  to  develop  this  matrix  it  is  necessary  to 

assign  to  each  objective  an  estimate  of  utility.  This  is 

done  in  such  a  way  that  if  Ik  is  the  utility  of  the  ith 

objective,  then  U./Uj  is  a  measure  of  the  utility  of  the  ith 

objective  to  the  jth  objective.  The  vector  U.,iu,...  U 

i  i  n 

will  be  called  a  ratio  scale.  A  matrix  can  be  constructed 
that  is  composed  of  the  subjective  estimates  of  all  possible 
pairwise  comparisons  of  the  objectives.  This  yields  the 
elements  A.j  of  the  matrix  in  Figure  3.8.1  each  element  A^j 
represents  the  estimate  U./lk.  Diagonal  elements  are  all 

J 

”1,"  since  they  represent  the  comparison  of  an  objective  to 
itself  ( A j j “U j / U | = 1 , i = 1 . . . n ) .  The  lower  triangular  elements 
represent  the  inverse  comparison  done  on  the  upper  triangu¬ 
lar  elements:  A..=i/Ai8.  Consequently,  only  half  of  the 
comparisons  of  objectives  need  be  solicited  for  filling  the 
matrix.  The  other  half  of  the  matrix  is  filled  with  the 


reciprocal  from  the  judgements  already  made 
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Figure  3.8  Pairwise  Comparison  Judgement  Matrix 


The  choice  of  a  scale  to  be  used  for  making  the  com¬ 
parisons  between  objectives  is  largely  arbitrary.  It  has 
been  shown  that  people  generally  find  it  difficult  to  rank 
more  than  about  seven  objects  at  a  time  (Saaty,  1980:p55). 
Saaty  therefore  recommends  a  subjective  pairwise  comparison 
scale  consisting  of  the  range  of  integers  from  one  to  nine 
including  their  reciprocals.  This  scale  results  in  a  value 
of  ”1”  being  assigned  to  pairs  of  objects  of  equal  impor¬ 
tance.  The  integers  ”3”,  ”5”,  ”7”,  and  "9"  correspond  to 
descriptive  words  (9  stands  for  ’’absolute  importance".  5 
stands  for  "essential  or  strong  importance",  and  so  forth), 
and  the  integers  ”2".  "4”,  ”6’’.  and  ”8”  represent  the  inter 
mediate  values.  Reciprocals  of  the  integers  are  necessary 
for  the  judgements  on  half  of  the  scale  to  ensure  a  recipro- 
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cal  symmetric  matrix.  See  Figure  3.9  for  an  example  of  a 
comparison  between  two  objectives  using  Saaty’s  comparison 
sea  1 e . 
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Figure  3.9  Example  Using  Saaty’s  Comparison  Scale 


If  minimizing  cost  is  weakly  more  important  than  maximizing 
performance,  then  the  number  ”3”  would  be  placed  in  the  aj2 
position  of  the  comparison  matrix.  The  reciprocal  ”1/3” 
could  immediately  be  placed  in  the  position. 

Since  A.,  estimates  U:/U:,  it  follows  immediately  that 

1 0  l  J 


A  matrix  with  positive  entries  that  exactly  satisfies  (.3.7) 
is  called  a  consistent  matrix.  The  ideal  pairwise 


comparison  matrix  demonstrates  this  property  of  consistency. 
As  an  example,  if  A  is  three  times  more  important  than  B. 
and  B  is  four  times  more  important  than  C,  it  would  be 
expected  that  A  would  be  twelve  times  more  important  than  C. 
Because  human  judgements  are  often  inconsistent,  a  judge 
making  pairwise  comparisons  would  probably  construct  an 
inconsistent  judgement  matrix,  unless  the  dimension  was 
small.  Recognizing  this,  it  is  necessary  to  find  a  way  to 
construct  a  ratio  scale  which  best  reflects  the  information 
in  the  matrix. 

As  defined  earlier,  A..  =  Uj/U;.  For  the  consistent 
case  let  A..  =  W • / W  •  ,  where  the  comparisons  are  based  upon 

A  J  1  J 

exact  measurements,  that  is,  Wp..,,W  are  already  known. 

Let  matrix  A  have  the  components  of  A.  .,  and  matrix  W  have 

A  J 

the  components  UL  .  Then  for  the  consistent  case: 


V"l 

Wj/W2  .  .  . 

VWn 

Wl" 

A  = 

V“i 

W2/W2  •  •  • 

w2/wn 

and  W  = 

W2 

V“1 

V*2  •  •  • 

VWn 

Wn 

An  important  result  of  this  is  that:  AW  =  n  W,  where  n 
is  the  dimension  of  matrix  A.  In  the  practical  case,  A.  . 

*  J 

deviates  from  W./V).(  but  for  the  consistent  case 

*  *J 

(the  eigenvalues)  are  numbers  that  satisfy  AX  -  Amax  X 


For  the  consistent  case  all  eigenvalues  are  zero  except 


for  one,  which  is  n.  For  the  inconsistent  case,  small 
changes  in  the  entries  of  A..,  of  the  positive  reciprocal 

*  J 

matrix  A.  induce  small  changes  in  the  eigenvalues.  These 
smaii  variations  in  from  consistency  keep  the  largest 

eigenvalue,  A  max,  close  to  n.  and  the  remaining  eigen¬ 
values  close  to  zero.  Therefore,  for  the  inconsistent  case, 

U  .  which  satifies: 

A  U  =  Amax  (j  (3.8) 

is  the  eigenvector  associated  with  Amax.  This  U  closely 
approximates  the  weights  of  the  consistent  case.  For 
further  computations,  U  is  normalized  because  the  weights 
for  the  objectives  being  compared  must  sum  to  one.  In  sum¬ 
mary,  Saaty  proposes  that  the  normalized  eigenvector 
corresponding  to  the  maximal  eigenvalue  of  the  judgement 
matrix  best  estimates  the  ratio  scale  for  inconsistent 
matrices  (Saaty,  1980:p49). 

Frobenius  gives  a  theorem  for  matrices  with  positive 
entries  (Franklin,  1968)  which  guarantees  that  any  judgement 
matrix  has  a  positive  eigenvalue  which  is  greater  than  all 
other  eigenvalues  in  absolute  value.  This  maximal  eigen¬ 
value  has  a  corresponding  eigenvector  which  is  positive  in 
all  of  its  components;  it  is  called  the  dominant  eigenvec¬ 
tor.  The  dominant  eigenvector  is  a  continuous  function  of 
the  elements  within  the  judgement  matrix,  and  if  the  matrix 
is  consistent,  the  eigenvector  gives  the  unique  scale  (to 
within  scalar  multiplication).  If  the  elements  have  small 


perturbations  due  to  the  human  judgement  process,  the  dom¬ 
inant  eigenvector  will  yield  a  scale  only  slightly  different 
from  the  scale  of  an  underlying  consistent  judgement  matrix. 

Saaty  developed  an  index  of  consistency  for  this  judge¬ 
ment  matrix.  He  demonstrated  that  an  nxn  judgement  matrix 
whose  only  non-zero  eigenvalue  is  n  must  be  consistent.  The 
maximal  eigenvalue  M  for  an  inconsistent  judgement  matrix  is 
strictly  greater  than  n.  Using  the  normalized  difference:  u 
=  ( M-n ) / ( n- 1 )  results  in  the  index  of  consistency  u,  of  an 
nxn  judgement  matrix  with  maximal  eigenvalue  M.  It  can  be 
seen  that  this  index  of  consistency  increases  as  perturba¬ 
tions  from  the  consistent  values  of  the  matrix  components 
increase . 

The  mechanism  by  which  small  perturbations  of  matrix 
components  give  rise  to  a  given  deviation  in  the  maximal 
eigenvalue  is  complicated.  Saaty  describes  an  empirical 
investigation  of  this  in  which  he  determines  the  consistency 
indices  corresponding  to  randomly  generated  judgement 
matrices  of  different  dimensions.  Because  the  eigenvector 
does  not  fit  into  any  standard  statistical  framework,  there 
is  not  a  readily  available  technique  against  which  devia¬ 
tions  from  consistency  can  be  measured. 

Consider  an  example  that  uses  the  hierarchy  shown  in 
figure  3.5.  To  determine  the  "strengths"  or  weightings 
between  elements  within  the  hierarchy,  it  is  necessary  to  do 


a  pairwise  comparison  at  each  subgroup  within  each  ievei. 
Each  element  within  the  subgroup  is  compared  to  every  other 
element  within  the  subgroup.  This  determines  the  importance 
that  element  has  with  respect  to  every  other  element  on  its 
level.  Figure  3.10  demonstrates  how  the  decision  maker’s 
comparisons  were  recorded  by  the  analyst  for  each  of  the 
elements  within  the  hierarchy.  Once  the  comparisons  have 
been  made,  the  results  are  placed  in  matrix  notation  as 
shown  in  figure  3.11.  The  eigenvalues  are  then  found.  The 
dominant  eigenvector  (eigenvector  associated  with  the  maxi¬ 
mal  eigenvalue)  when  normalized,  directly  gives  a  vector 
representing  the  respective  objective  weightings.  These 
resultant  weightings  are  shown  in  Figure  3.12. 
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3.4.1  1  ntroduct i on  ■  The  procedures  described  in  the  previ¬ 
ous  sections  enable  the  analyst  to  develoD  a  weighted 
hierarchy  of  objectives  based  on  the  decision  makers 
preferences.  The  analyst  must  now  work  with  the  decision 
maker  to  construct  a  value  function  for  each  performance 
index  in  the  hierarchy  tree.  As  a  reminder,  the  performance 
indices  are  attributes  that  measure  the  degree  to  which  the 
lowest  level  objectives  are  attained.  Using  the  weighted 
hierarchy  tree  and  the  individual  value  functions,  a  scalar 
figure  of  merit  can  be  determined  for  each  candidate  solu¬ 
tion  in  the  non~dominated  solution  set.  The  figure  of  merit 
has  the  advantage  of  being  a  single  index  that  represents 
the  relative  preference  the  decision  maker  has  for  a  partic¬ 
ular  solution.  The  MOSS  may  then  be  rank-ordered  using  these 
figures  of  merit,  to  provide  the  DM  with  a  ranked  listing  of 
optimal  solutions  based  on  his  own  preferences.  This  sec¬ 
tion  describes  how  value  functions  are  solicited  from  the 
decision  maker. 

A  value  function  is  a  mapping  of  the  measurement  of  a 
performance  index  to  the  utility  or  ’’value"  that  the  deci¬ 
sion  maker  associates  with  it.  This  function  is  easily 
graphed,  with  the  range  of  measures  of  the  performance  index 
on  the  abscissa,  and  the  associated  values  for  each  measure. 

Vj(Xj),  on  the  ordinate.  The  endpoints  for  the  range  of 
measures  on  the  abscissa  may  be  selected  in  several  ways. 


One  method  is  to  set  the  lower  bound  at  the  least  acceptable 
measure  and  the  upper  bound  at  the  most  acceptable  measure. 


The  analyst  tiien  suliuiis  the  decision  maker  for  his 
"values"  at  three  points  between  these  endpoints.  This 
information  allows  the  analyst  to  fit  a  curve  through  those 
points.  The  resultant  curve  represents  the  decision  maker’s 
value  function  for  that  performance  index.  The  following 
example  demonstrates  these  procedures. 

3.4.2  Value  Function  Curve  Shape.  Figure  3.7  represents  a 
simple  hierarchy  of  objectives  for  selecting  a  satellite 
servicing  system.  It  has  four  performance  indices  --  ini¬ 
tial  cost,  (operating  cost)/time,  reliability,  and  (.mass  of 
payload  delivered  to  orbit)/time.  This  example  demonstrates 
construction  of  a  value  function  for  initial  cost. 

it  is  assumed  that  the  least  acceptable  initial  system 
cost  is  $100  billion  and  the  most  acceptable  initial  cost  is 
$10  billion.  If  the  value  ”0"  is  assigned  to  $100  billion 
and  the  value  ”1”  is  assigned  to  $10  billion,  the  value 
function  curve  is  described  by  the  set  of  points  that  lies 
between  the  two  endpoints.  There  are  different  techniques 
that  may  be  used  for  determining  the  shape  of  this  curve. 

One  of  the  methods  described  in  section  3.1  is  the  midvalue 
splitting  technique.  This  technique  requires  one  to  find 
the  midpoint  value  between  the  upper  and  lower  bounds.  The 
analyst  can  determine  this  value  during  a  session  with  the 
decision  maker  by  asking  him  to  answer  the  question  in  the 


following  scenario  (Chankong  and  Haimes.  1983:188): 

The  values  of  all  performance  indices  (except  initial 
cost)  are  fixed  at  their  lowest  levels.  Suppose  you  are 
given  two  situations: 

1)  The  initial  cost  of  a  satellite  servicing  sys¬ 
tem  is  first  estimated  to  be  $55  billion.  Later 
you  are  told  that  a  mistake  was  made  -  the  ini¬ 
tial  cost  should  be  $10  billion. 

b)  The  initial  cost  is  estimated  to  be  $100  bil¬ 
lion.  Later  you  discover  it  should  be  $55  bil¬ 
lion. 

% 

Would  you  be  more  delighted  in  your  discovery  in 
the  first  situation  or  the  second,  or  would  you 
feel  equally  delighted  in  both  cases? 

If  the  decision  maker  shows  greater  preference  for  the 
first  situation,  a  point  should  be  picked  between  $10  bil¬ 
lion  and  $55  billion,  say  $45  billion,  and  the  question 
repeated  with  $45  billion  replacing  $55  billion.  If  the 
decision  maker  is  less  delighted  to  go  from  $45  billion  to 
$10  billion  than  to  go  from  $100  billion  to  $45  billion,  yet 
another  point  in  the  preferred  range  should  be  picked,  say 
$50  billion,  and  the  process  repeated.  If  the  decision 
maker  is  exactly  as  delighted  to  go  from  $100  billion  to  $50 
billion  as  from  $50  billion  to  $10  billion,  the  midpoint 
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between  $10  billion  and  $100  billion  is  X(0.5)  =  $50  bil¬ 
lion.  Using  the  same  process  the  midpoints  for  X(0.25)  and 
X(0.75)  may  be  found.  Suppose  that  X(0.25)  =  $75  billion 
and  X(0.75)  =  $30  billion.  To  check  for  consistency,  the 
decision  maker  should  verify  that  he  would  be  equally 
delighted  to  go  from  $50  billion  to  $30  billion  as  to  go 
from  $75  billion  to  $50  billion.  If  not,  X(0.5)  should  be 
adjusted  accordingly,  and  X(0.25)and  X(0.75)  should  be 
checked  again.  Suppose  the  values  X(0.25)  =  $77.5  billion. 
X(0.5)  =  $55  billion,  and  X(0.75)  =  $32.5  billion  are  found 
to  be  consistent.  Then  a  plot  of  these  points  can  be  made 
and  an  appropriate  curve  can  be  fitted  through  these  points 
as  shown  in  Figure  3.13.  The  shape  of  this  curve  should  be 
examined  by  the  decision  maker  to  confirm  its  validity  for 
his  preferences. 

Computer  programs  are  available  that  will  aid  in  find¬ 
ing  the  shape  of  each  value  function.  MADAM  (Stimpson , 1983) 
is  one  such  package  that  uses  the  midvalue  splitting  tech¬ 
nique  and  curve-fits  the  points  to  one  of  five 


.? 


curves  (see  figure  3.14): 
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Figure  3.13  Value  Function  Curve  for  Initial  Cost 
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Figure  3.14  Curve-Fits  for  Value  Functions  in  MADAM 
(DeWispelare  and  St i mpson , 1983 : 1 b ) 


A  value  function  must  be  determined  for  each  perfor¬ 
mance  index;  it  relates  the  measure  of  that  Pi  to  the  util¬ 
ity  that  measure  has  in  the  mind  of  the  decision  maker. 

Thus  for  the  simple  hierarchy  tree  of  Figure  3.7.  a  value 
function  would  be  determined  for  initial  cost,  operating 
cost/time,  reliability,  and  mass  of  payload  del i vered/time . 


Since  every  individual  has  unique  preferences,  it  is 
unlikely  that  two  decision  makers  will  have  the  same  exact 
value  function  for  any  particular  performance  index.  For 
the  performance  indices  being  used  in  this  study,  ’’more”  is 
"better”  in  general,  so  linear  value  functions  would  not  be 
unexpected.  Consequently,  linear  value  functions  have  been 
used  for  all  decision  makers  in  this  study  to  emphasize 
differences  among  decision  makers  based  on  preferences 
a  1  one . 


As  seen  from  the  example  above,  to  find  the  value  func¬ 
tion  curve  shape,  the  range  of  the  performance  index  must  be 
specified.  One  method  for  specifying  the  range  is  to  find 
the  highest  and  lowest  measures  of  the  PI  from  the  NDSS . 

The  appropriate  value,  zero  or  one.  is  assigned  to  those 
measures  accordingly,  and  one  of  the  several  techniques  is 
then  used  to  determine  the  points  in-between. 


It  is  important  that  an  identical  approach  be  used  for 
assigning  values  for  each  PI.  In  the  above  example,  the 
objective  was  to  minimize  initial  cost.  Consequently,  the 
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value  ”0”  was  assigned  to  the  least  acceptable  cost,  and  the 


value  ”1”  was  assigned  to  the  roost  acceptable  cost.  Like¬ 
wise,  if  the  objective  is  to  maximize  reliability,  the 
value  ”0”  should  be  assigned  to  the  least  acceptable  relia¬ 
bility,  and  the  value  ”1"  to  the  most  acceptable  reliabil¬ 
ity.  This  will  keep  the  comparisons  in  the  correct  order, 
even  though  the  numerical  measures  of  the  PI  may  be  inverse 
relationships.  in  other  words,  the  smallest  initial  cost  is 
best,  while  the  largest  reliability  measure  is  best. 

Caution  must  also  be  exercised  when  setting  up  the 
range  on  the  value  function  for  each  PI.  The  decision  maker 
must  compare  the  ranges  for  each  performance  index  and 
ensure  that  the  values  are  comparable.  For  example,  suppose 
the  initial  cost  of  a  system  amortized  for  the  year,  ranged 
in  the  NDSS  between  $10  billion  and  $100  billion,  and  the 
operating  cost  per  year  ranged  between  $500,000  and  $2  mil¬ 
lion.  Using  these  measures  to  specify  the  range  for  determ- 
ing  the  value  function  is  equivalent  to  saying  that  $10  bil¬ 
lion  of  initial  cost  has  the  same  value  to  the  decision 
maker  as  $500,000  of  operating  cost.  If  the  decision  maker 
involved  feels  that  this  is  not  a  valid  comparison,  he  has 
one  of  two  choices.  One  solution  is  to  create  a  pseudo¬ 
range;  that  is,  adjust,  the  endpoints  of  the  range  until  the 
comparisons  are  valid.  if,  however,  the  decision  maker 
feels  that  one  dollar  should  have  the  same  ’’value”  all  the 
time,  regardless  of  what  it  is  measuring,  he  should  use 
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identical  ranges  for  all  performance  indices  using  dollars 
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as  the  measure.  This,  in  some  instances,  will  compress  the 
performance  index  ’’values”  towards  one  end  of  the  scale. 
However,  there  is  nothing  inherently  wrong  with  that  if  it 
accurately  represents  the  decision  maker’s  values.  This 
same  procedure  applies  to  comparisons  for  all  performance 
index  measures,  be  they  dollars  versus  dollars,  or  reliabil¬ 
ity  versus  pounds  of  mass  delivered  to  orbit.  This  con¬ 
sistency  in  scaling  the  value  functions  for  each  performance 
index  is  also  necessary  to  allow  sensitivity  analyses  for 
the  decision  maker’s  values.  Sensitivity  analysis  of  the 
value  system  is  examined  in  Chapter  VI. 


3.5  Calculation  of  the  Figure  of  Merit 


Once  the  value  functions  are  defined,  each  performance 
index  in  the  NDSS  will  have  a  distinct  ’’value”  associated 
with  it.  This  section  demonstrates  how  a  value  function  is 
used  with  the  weighted  hierarchy  tree  to  obtain  a  figure  of 
merit  for  each  solution  in  the  NDSS. 


Consider  the  weighted  hierarchy  tree  in  Figure  3.15, 
with  performance  indices  Zj  (initial  cost),  (operating 
cost/time),  (reliability),  and  Z^  (mass  of  payload 
del ivered/ time) . 
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“ 
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RELIABILITY - 


MAXIMIZE  (0.17) 
MASS  OF  PAYLOAD 
DELIVERED/TIME 


Figure  3.15  Weighted  Hierarchy  Tree  for  Value  System 
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Assume  one  of  the  solutions  in  the  NDSS  is  the  following- 

Zj  =  $77.5  million 
Z2  =  $32.5  mi  1 1  ion/year 
Z3  =  .90 

Z4  =  43800  kg/year 

If  the  ranges  of  the  performance  indices  and  the  shapes 
of  the  value  functions  are  known,  a  value  for  the  level  of 
each  PI  can  be  found.  The  following  values  were  derived 
from  the  appropriate  value  function  curves  (Figures  3.16  to 
3.19): 

VCZj)  =  V< 77 . 5  M)  =  .25 
V(Z2)  =  V ( 32 . 5  M)  =  .75 
V(Z3)  =  V<  .90)  =  .80 

=  .60 


V(Z4)  =  V<43800) 


VALUE 


VALUE 


Mote  that  the  value  functions  range  between  zero  and 


one.  Because  of  this  and  because  each  candidate  solution  in 
the  NDSS  uses  the  same  single-attribute  value  function  for 
each  individual  PI,  the  "values”  from  the  functions  can  be 
applied  directly  to  the  weighted  hierarchy  tree.  Since  an 
additive  value  function  is  being  used,  the  figure  of  merit 
is  calculated  by  multiplying  the  PI  "value”  by  the  tree 
level  weight,  and  summing  at  each  level  of  the  tree.  The 
value  at  each  level  (except  the  bottom  level)  is  simply  the 
summation  of  the  (weight  x  value)  calculations  of  the  level 
just  below  it. 

From  Figure  3.15,  where 
TC  is  Total  Cost 
PERF  is  Performance 
IC  is  Initial  Cost 
OC  is  Operating  Cost 
REL  is  Reliability,  and 


VA 


MPD  is  Mass  of  Payload  Delivered 

Wt  is  hierarchy  weighting,  and  Val  is  value  of  PI 

from  value  function 
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Figure  of  Merit  =  (Wt  of  TC)  *  (Val  of  TC) 


+ 

(Wt 

of 
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=  0.44275 


When  these  calculations  are  repeated  using  the 
appropriate  "values”  for  each  solution  in  the  NDSS,  a  scalar 
figure  of  merit  is  derived  for  each  solution.  The  NDSS 
solutions  may  then  be  rank-ordered  using  the  figure  of  merit 
as  the  measure  of  desirability  for  each  system  solution. 

Now  the  analyst  can  present  to  the  decision  maker  a  list  of 
optimal  solutions  that  have  already  been  ranked  by  the  DM ’ s 
own  preferences.  Chapter  VI  demonstrates  ranking  of  the 
solutions  in  an  NDSS. 

For  a  large  NDSS  it  may  be  desirable  to  automate  these 
calculations  using  a  computer.  One  such  computer  program 
was  developed  for  the  simple  hierarchy  of  Figure  3.15,  and 
may  be  found  in  Appendix  C. 
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Value  System  Summar 


Every  decision  maker  has  a  unique  value  system,  which 
is  simply  a  formal  mathematical  representation  of  his 
preferences.  If  certain  axioms  are  met,  a  mapping  of  those 
preferences  to  a  value  scale  can  be  accomplished.  This  map¬ 
ping  is  referred  to  as  a  utility  function  for  mappings 
involving  ’’uncertain  alternatives.”  For  functions  with 
’’certain  alternatives,”  it  is  called  a  value  function.  The 
two  most  common  functional  forms  of  these  functions  are  the 
additive  and  the  multiplicative  forms.  The  appropriate  form 
is  identified  by  satisfying  certain  necessary  and  sufficient 
conditions  of  independence  among  the  objectives  in  the  prob- 
1  em . 


A  common  structural  formulation  for  the  objectives  in  a 
multiple-objective  problem  is  in  the  form  of  a  hierarchy 
tree.  By  accomplishing  pairwise  comparisons  between  objec¬ 
tives  at  each  level  of  the  tree,  a  weighting  for  the  prefer¬ 
ence  of  each  objective  may  be  determined. 


At  the  lowest  level  of  the  tree  are  the  objectives  to 
which  measurable  descriptors  can  be  applied.  Each  one  of 
the  descriptors,  or  attributes  (performance  indicies).  has 
an  associated  value  function  (or  utility  function).  This 
function,  which  has  values  between  zero  and  one,  describes 
the  utility  that  the  decision  maker  places  on  the  range  of 
the  measure  of  that  attribute. 
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Each  solution  out  of  the  nondominated  solution  set 
(each  representing  a  different  candidate  system  configura¬ 
tion)  will  have  an  associated  value  for  each  performance 
index  measure.  These  values  can  be  directly  applied  to  the 
weightings  in  the  hierarchy  tree.  For  an  additive  value 
function,  the  objective  weighting  is  multiplied  by  the  per¬ 
formance  index  ’’value”,  and  summed  at  each  tree  level  to 
determine  the  value  for  the  objective  in  the  level  above  it. 
This  is  continued  until  a  scalar  figure  of  merit  is  derived 
at  the  top  of  the  tree.  In  this  way,  each  candidate  system 
configuration  from  the  nondominated  solution  set  can  be 
given  a  single  ’’measure  of  desirability”  or  ’’figure  of 
merit.”  These  figures  of  merit  may  then  be  rank  ordered  to 
provide  the  decision  maker  with  a  ranked  listing  of  solu¬ 
tions  based  on  his  own  preferences. 

Chapter  VI  demonstrates  the  calculation  of  a  figure  of 
merit  for  each  candidate  solution  in  a  nondominated  solution 
set,  using  the  preferences  of  different  decision  makers. 

The  solutions  are  then  ranked  using  the  figures  of  merit  to 
give  the  ’’best  solution”  for  each  decision  maker. 


IV.  Alternatives  Generation  (System  Synthesis  and  Modeling) 

4 . 1  I ntroduct ion . 

The  purpose  of  modeling  is  to  describe  in  some  fashion 
the  system  under  study  in  such  a  way  as  to  be  useful  in 
analyzing  the  performance  of  that  system.  The  type  of  model 
used  in  this  effort  is  an  analytical  model  (set  of  equa¬ 
tions)  cast  into  a  statespace  form.  The  purpose  of  this 
chapter  is  to  present  in  a  clear  and  logical  fashion  what 
these  equations  represent.  However,  the  number  of  equations 
is  quite  large  (over  27)  and  many  of  them  are  non-linear. 
Rather  than  list  and  describe  each  equation  separately,  the 
equation  development  process  is  presented.  In  this  way  the 
definitions,  assumptions,  and  limitations  of  the  model  equa¬ 
tions  should  become  clear. 

Typically,  equations  to  represent  a  complex  system  such 
as  a  Satellite  Servicing  System  (SSS)  cannot  be  developed  in 
one  step.  When  an  analyst  first  starts  to  build  such  a 
model  he  may  only  have  a  partial  idea  of  the  important  fac¬ 
tors  in  the  problem  and  the  simplifications  that  can  be 
made.  Therefore,  it  is  often  advantageous  to  model  the 
inter-relationships  of  the  complex  system  iteratively, 
starting  from  the  most  basic  conceptual  models  and  evolving 
through  stages  to  its  final  form.  Ultimately  only  those 
factors  relevant  to  the  problem  should  be  included  in  the 
model.  However,  for  many  complex  systems  the  concept  of  the 
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problem  and  its  scope  are  not  readily  apparent.  Often,  it 
is  only  through  repeated  iterations  of  forming,  implement¬ 
ing,  and  analyzing  models  of  increasing  detail  that  an 
analyst  can  get  a  good  feel  for  the  problem,  its  scope,  and 
the  important  factors  to  describe  the  system  in  light  of  the 
problem  definition.  For  clarity,  the  results  of  this  itera¬ 
tion  process  (as  used  in  this  study)  are  presented  in  two 
sections . 

The  first  section  (conceptualization)  deals  with  the 
evolution  of  the  basic  conceptual  models  just  prior  to  equa¬ 
tion  development.  These  "picture”  models  are  first  formed 
through  model  synthesis.  During  this  process,  important 
design  objectives  for  a  military  SSS  are  identified  and  can¬ 
didate  subsystems  are  defined  to  perform  the  system  func¬ 
tions  of  delivering  mass  from  earth  to  orbit  and  delivering 
mass  from  orbit  to  the  satellites.  Combining  these  subsys¬ 
tems  in  every  way  possible  generates  forty-five  candidate 
SSS  architectures.  These  architectures  are  analyzed  on  a 
qualitative  level  for  realizability.  Based  on  defined 
assumptions,  twelve  SSS  architectures  are  identified  as 
"feasible."  These  feasible  systems  are  then  qualitatively 
compared  to  each  other  in  terms  of  how  well  they  achieve  the 
performance  objectives.  The  result  is  a  set  of  four  candi¬ 
date  SSS  architectures  identified  for  further  detailed 
modeling  in  the  form  of  equation  development. 
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The  second  section  (analytical  models)  describes  the 


quantitative  models  developed  for  the  chosen  architectures. 
The  level  of  detail  represented  by  the  equations  could  not 
be  used  to  differentiate  between  two  of  the  systems;  there¬ 
fore.  one  equation  set  models  two  systems.  A  total  of  three 
analytical  statespace  models  is  presented.  First,  the  form 
and  terms  of  a  statespace  model  are  defined,  followed  by  a 
qualitative  discussion  of  the  three  model  equation  sets.  A 
complete  listing  of  the  three  sets  of  analytical  equations 
is  in  Appendix  D. 

The  application  of  multiple  objective  optimization 
theory  (MOOT)  techniques  to  one  set  of  these  equations,  and 
the  analysis  of  the  subsequent  results,  is  presented  in 
Chapter  V.  One  purpose  of  analysis  is  to  determine  the 
impact  of  modeled  states  on  the  overall  performance  of  the 
system.  If  changing  a  state,  such  as  time  between  launches 
of  a  launch  vehicle,  has  little  effect  on  the  performance  of 
all  systems  considered,  then  that  state  variable  (or  associ¬ 
ated  equations)  can  either  be  fixed  at  a  constant  or  removed 
from  the  model .  This  demonstrates  the  importance  of  itera¬ 
tively  forming,  implementing,  and  analyzing  a  model 
throughout  its  development.  It  should  be  noted  that  further 
refinement  of  the  model  equations  is  possible  many  times  due 
to  the  results  of  analysis  techniques  such  as  those  in 


chapter  V. 


4 . 2  Model  Conceptualization 


4.2.1  System  Synthesis.  Before  developing  model  equa¬ 
tions  to  describe  candidate  systems,  the  concept  of  the  sys¬ 
tem  must  be  formed.  This  synthesis  process  is  concerned 
with  answering  several  questions'.  What  are  the  objectives  of 
the  system  with  respect  to  the  problem  statement?  What  are 
the  alternative  approaches  for  attaining  each  objective? 

How  is  each  approach  described?  How  does  one  measure 
attainment  of  each  alternative  approach?  (Sage,  1977:73) 

The  model  will  be  used  to  measure  the  performance  of 
the  candidate  SSS  it  is  designed  to  represent.  As  is  the 
case  with  many  problems,  there  are  multiple  objectives  (many 
conflicting)  to  which  a  military  SSS  can  be  designed.  During 
the  initial  synthesis  the  following  seven  objectives  were 
thought  to  be  important  from  a  military  viewpoint:  low 
operating  costs,  low  initial  costs,  high  mass  delivered  to 
satellites,  high  survivability,  high  flexibility,  high  reli¬ 
ability,  and  improved  satellite  performance. 


Since  the  SSS  under  study  is  assumed  to  be  purchased 
and  operated  by  the  Department  of  Defense  (DoD),  initial  and 
operating  costs  will  be  important  to  a  DoD  level  decision 
maker.  Initial  cost  is  a  key  factor  to  get  funding  approval 
and  support,  while  operating  cost  is  important  for  DoD 
budgetary  planning. 


How  well  a  SSS  accomplishes  its  mission  is  important  to 
describe  to  the  funding  authority  what  he  is  getting  for  his 
money.  This  objective  should  be  a  measure  of  how  well  the 
system  does  the  task  it  was  designed  to  accomplish.  If  for 
example,  an  automobile  was  the  system  of  interest  this  would 
be  analogous  to  asking  how  fast  it  will  go,  how  many  people 
it  can  carry,  or  how  comfortable  the  ride  is  for  the  people. 
In  the  SSS  system  one  measure  of  mission  accomplishment  is 
how  much  mass  (satellite  expendables  and  parts)  the  SSS  can 
deliver  to  the  satellites  over  a  period  of  time. 

National  Security  Decision  Directive  42  (NSDD-42) 
announced  4  July  1982  and  the  DoD  Space  Policy  (Dept.  AF 
, 1985:Ch  15)  state  that  future  space  systems  must  be  built 
with  survivability,  flexibility,  and  reliability  in  mind. 

One  of  the  unique  requirements  for  most  military  systems  (as 
compared  to  non-military)  is  the  requirement  to  operate  in 
an  adverse  environment  or  in  less  than  ideal  conditions. 
Survivability  is  a  measure  of  the  system’s  ability  to  per¬ 
form  under  these  conditions.  NSDD-42  states  "The  United 
States  will  pursue  survivability  and  endurance  of  space  sys¬ 
tems  ....  to  perform  the  mission”  (Dept.  AF  ,1985:15-8). 
Survivability  also  includes  a  space  system’s  ability  to  sur¬ 
vive  meteoroid  collisions  and  the  effects  of  space  radiation 
(Dept.  AF  ,1985:1-10). 


The  flexibility  of  a  SSS  is  a  measure  of  the  ability  of 
a  system  to  operate  in  unforseen  or  diverse  situations.  The 
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DoD  Space  Policy  (Dept.  AF  ,1985:15-10)  requires  "the  avai 


lability  of  an  adequate  launch  capability  to  provide  flexi 


bie  and  responsive  access  to  space  to  meet  national  security 


requirements.”  Although  this  requirement  specifies  launch 


systems,  it  seems  logical  to  assume  this  policy  of  flexibil¬ 


ity  would  extend  to  all  space  systems.  In  this  study  the 


flexibility  objective  is  intended  to  be  a  measure  of  the  SSS 


ability  to  perform  a  wide  variety  of  potential  tasks.  In 


the  case  of  an  SSS,  flexibility  may  be  the  deciding  factor 


between  selecting  a  manned  or  robotic  system. 


Current  and  future  space  systems  are  extremely  expen¬ 


sive;  therefore,  their  accuracy,  efficiency,  and  dependabil¬ 


ity  is  of  paramount  importance.  The  Space  Handbook  (Dept.  AF 


,1985:10-1)  states: 


"The  advent  of  missiles  and  space  systems  has  out¬ 
moded  the  ’fly  and  fix’  philosophy.  Good  systems 
must  operate  when  fired  ...  To  accomplish  this  end 
both  manufacturers  and  operators  of  space  systems 
must  pay  more  to  attention  than  ever  before  to  the 
reliability  of  the  system  as  a  whole  ...  Reliabil¬ 
ity  is  a  term  meaning  the  probability  that  equip¬ 
ment  will  perform  a  required  function  under  speci¬ 
fied  conditions,  without  failure,  for  a  specified 
period  of  time”. 


Another  acceptable  definition  is  the  probability  a  system 


will  be  able  to  perform  a  specified  function  when  required 


In  this  study  the  reliability  objective  is  intended  to  be  a 


measure  of  the  SSS  ability  to  perform  a  specific  mission. 


Finally,  how  effectively  a  SSS  improves  the  performance 


of  satellites  may  be  important  to  the  decision  maker 
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justifying  the  need  for  a  SSS .  The  design,  production,  and 
deployment  of  a  servicing  system  is  of  no  value  if  the  per¬ 
formance  and  availability  of  the  serviced  satellites  are  not 
improved . 

In  addition  to  establishing  what  the  important  objec¬ 
tives  of  the  sytem  are,  the  boundaries  of  that  system  must 
be  identified.  For  without  the  concept  of  boundaries  the 
system  description  (equations)  could  grow  without  end.  In 
this  study,  the  boundaries  of  a  SSS  are  established  by 
describing  a  SSS  in  terms  of  its  two  functional  areas:  (1) 
getting  mass  from  Earth  to  orbit  and  (2)  getting  that  mass 
from  orbit  to  a  satellite  needing  service. 

Various  subsystems  are  defined  to  accomplish  these  two 
functions  as  depicted  in  Figure  4,1.  The  objective  of  the 
study  is  to  identify  one  or  more  configuration  alternatives 
for  the  SSS,  using  combinations  of  the  subsystems  which 
accomplish  the  two  mission  functions.  The  following 
describe  these  subsystems  in  detail. 

Mass  from  Earth  to  orbit  (Launch  systems) 

Fixed  High-G  (FHG)  launch  system:  A  mass  delivery  sys¬ 
tem  which  launches  from  a  fixed  location.  The 
acceleration  of  the  vehicle  is  beyond  human  tolerance 
levels  (about  5  g's)  for  an  extended  period  of  time  and 
beyond  sensitive  electric  equipment  design  loads.  This 
is  envisioned  to  be  a  swift  and  economical  mass 
delivery  system.  A  hydrogen  blast  tube  (Eklund,  1984) 
could  be  such  a  system. 


Mobile  High-G  (MHG)  launch  system:  Similar  to  an  FHG 
except  the  launch  site  is  not  geographically  fixed. 

This  subsystem  adds  a  degree  of  survivability  due  to 
the  mobile  launch  location. 

Fixed  Low-G  (FLG)  launch  system:  A  mass  delivery  sys¬ 
tem  which  launches  from  a  fixed  location.  Human  beings 
and  sensitive  electronic  equipment  can  withstand  the 
acceleration  of  the  vehicle.  This  subsystem  provides  a 
means  of  getting  required  supplies  (sensitive  electron¬ 
ics)  in  space.  It  also  adds  a  degree  of  flexibility 
due  to  roan’s  potential  presence  in  space.  The  NASA 
shuttle  is  an  example  of  a  FLG  launch  system. 

Mobile  Low-G  (MLG)  launch  system:  Similar  to  an  FLG 
except  the  launch  site  is  not  geographically  fixed. 
Therefore,  this  subsystem  adds  a  degree  of  survivabil¬ 
ity  due  to  the  mobile  launch  location.  The  Trans- 
Atmospheric  Vehicle  (TAV)  under  study  (Covault,  1985) 
could  be  such  a  system. 


Mass  from  orbit  to  satellite  (Service  systems) 


Orbital  Servicing  Vehicle  (OSV):  A  spacecraft,  either 
manned  or  unmanned,  desi  ined  to  change  orbit  altitudes 
and  inclinations  in  order  to  deliver  mass  to  satellites 
requiring  service.  Once  at  the  satellite,  men  or 
robots  aboard  the  craft  will  perform  the  necessary  ser¬ 
vicing  functions  to  the  satellite.  Man’s  presence  adds 
flexibility  while  robots  decrease  flexibility.  The 
costs  to  operate  robots  is  envisioned  to  be  less  than  a 
manned  system  because  a  robotic  system  does  not  have 
costs  associated  with  life  support.  Potential  concepts 
under  study  by  NASA  include  the  Orbital  Maneuvering 
Vehicle  or  OMV  (NASA,  1985)  and  the  Orbital  Transfer 
Vehicle  or  OTV  CAerospace”,  1982). 

Space  Base  (SB):  An  Earth  orbiting  structure  incapable 
of  autonomous  major  changes  in  orbit.  However  it  has 
station  keeping  propulsion  to  maintain  a  fixed  earth 
orbit  for  long  periods  of  time.  This  structure  may  be 
manned  or  unmanned  and  is  capable  of  long  term  storage 
of  satellite  supplies.  It  also  can  act  as  a  repair 
hanger  for  tie  OSV  and  satellites.  This  subsystem  adds 
flexibility  by  providing  supplies  (and  possibly  man)  in 
space  where  they  are  immediately  available  when  needed. 
This  would  in  general  improve  response  times.  NASA  is 
reviewing  concepts  for  a  Space  Station  (NASA,  1984b>. 
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Figure  4.1  SSS  Subsystem  Options 


With  the  above  subsystem  definitions  different  archi¬ 
tectures  for  a  SSS  can  be  easily  described  through  various 
combinations  of  launch  and  service  systems.  However,  not 
all  the  resulting  45  possible  system  architectures  shown  in 
Table  4.1  are  realistic. 


4.2.2  Analysis  to  Identify  Feasible  SSS  Architectures. 

Since  it  is  assumed  that  replacement  equipment  for  satel¬ 
lites  is  composed  of  sensitive  electronics,  then  those  sys¬ 
tems  having  only  an  FHG  or  MHG  as  the  sole  launch  system  are 
not  considered.  It  seems  unlikely  th*>t  a  launch  system 
designed  for  mobility  can  also  be  designed  to  withstand 
loads  from  a  high-G  launch.  Additionally,  such  a  system 
would  require  a  large  portable  power  supply  to  achieve  the 
desired  acceleration.  Such  physical  realizations  seem 
unlikely,  therefore,  the  architectures  using  MHG  launch  sys¬ 
tems  are  also  not  considered. 
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Table  4 . 1 


Finally,  it  is  assumed  that  future  satellite  designs 
would  not  include  major  orbit  changing  capabilities  since 
there  is  a  heavy  cost  penalty  in  terms  of  launch  weight  and 
design  complexity  when  including  a  propu 1 s i on/ gu i dance  pack 
on  each  satellite.  In  future  satellites  configured  as  func¬ 
tional  modules  attached  to  a  common  platform,  if  one  module 
needs  servicing  it  is  unlikely  that  the  platform  will  be 
moved  to  a  SB  (for  servicing)  because  that  would  mean  taking 
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done  for  MASA  indicate  that  on-orbit  servicing  is  desirable 
(Heald,  1981)  and  that  a  servicing  vehicle  is  an  integral 
part  of  the  system.  Therefore,  those  systems/architectures 
that  are  comprised  of  an  SB  and  launch  system  only  (no  OSV) 
are  eliminated.  Table  4.2  lists  the  resulting  12  feasible 
systems  and  the  key  assumptions  made  in  selecting  them. 

Table  4.2 

Feasible  SSS  Configurations  with  Assumptions 

Feasible  SSS 

FLG+OSV  FHG+MLG+OSV  FHG+FLG+SB+OSV 

MLG+OSV  FLG+SB+OSV  FLG+MLG+SB+OSV 

FHG+FLG+OSV  MLG+SB+OSV  FHG+MLG+SB+OSV 

FLG+MLG+OSV  FLG+MLG+FHG+OSV  FHG+FLG+MLG+SB+OSV 

Assumptions 

.  Mobile  high-G  launch  is  not  feasible. 

.  Satellite  supplies  will  include  sensitive  electronics 
requiring  low-G  launch. 

.  Once  placed  in  orbit,  satellites  will  not  be  capable  of 
■ _  autonomous  orbit  changes. 

This  reduction  of  45  possible  system  architectures  to 
12  feasible  systems  demonstrates  how  one  may  take  into 
account  the  environment  and  bounds  of  the  problem  into  the 
modeling  process.  Such  simplifications  are  often  needed  to 

avoid  including  unnecessary  information  in  the  model  and 
thus  better  focus  the  efforts  of  the  analyst. 


4.2.3 


4.2.3  Selecting  Four  SSS  for  Equation  Development.  To 

reduce  the  focus  for  detail  modeling  a  smaller  number  of 
candidate  systems  is  selected  from  the  set  of  12  which  on  a 
gross  level  best  achieves  each  of  the  objectives.  In  this 
approach  the  systems  are  qualitatively  rank  ordered  in  each 
objective.  The  concept  of  Pareto  optimality  (to  be 
described  later)  is  used  on  this  ranking  to  identify  those 
SSS  configurations  which  are  non-domi nated .  This  reduced 
set  of  configurations  will  be  studied  in  more  detail  for 
equation  development. 


The  approach  used  to  generate  the  qualitative  rankings 
is  a  novel  application  of  Interpretive  Structural  Modeling 
(ISM).  Under  certain  conditions  ISM  can  be  used  to  form  a 
hierarchy  tree  with  the  feasible  systems  at  various  levels 
of  the  tree.  The  hierarchy  is  interpreted  as  a  rank  order¬ 
ing  of  the  systems.  A  cursory  description  of  ISM  is  now 
presented  before  discussing  the  results  of  its  application 
to  the  12  feasible  SSS  configurations. 


4.2.3. 1  Interpretive  Structural  Modeling  (Sage,  1977:Ch 
4) .  The  complexity  of  systems  exists  because  of  the  large 
number  of  elements  (components)  and  the  different  types  of 
interactions  between  those  elements.  These  elements  and 
interactions  take  on  various  forms.  They  may  be  components 
of  a  mechanical  system,  or  in  another  form,  theoretical  con¬ 
cepts  tied  together  to  establish  a  hypothesis  in  an 
individual’s  mind. 
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In  any  form,  complex  systems  have  a  characteristic 
called  "structure.”  Sometimes  this  structure  is  obvious, 
such  as  in  a  managerial  organization  in  a  corporation,  or  at 
times  it  is  less  obvious,  such  as  the  value  system  of  a 
decision  maker.  In  the  physical  sciences,  structure  is 
articulated  through  mathematics,  whereas  in  the  social  sci¬ 
ences,  articulation  of  structure  is  not  done  in  such  a  clear 
fashion.  Whether  articulated  or  not,  an  analyst  must  deal 
with  the  structure  of  a  complex  system  when  attempting  to 
describe  it.  A  well  defined  structure  is  an  invaluable  aid 
to  forming  a  clear  description  of  the  system  which  also  can 
assist  a  decision  maker  to  make  better  decisions  about  the 
system . 

A  common  approach  to  represent  and  define  structure  is 
through  the  use  of  graphs.  For  example,  a  chart  of  the 
managerial  organization  in  a  corporation  is  such  a  represen¬ 
tation.  One  way  to  transform  unclear,  poorly  articulated 
mental  models  of  systems  into  visible,  well  defined  graphi¬ 
cal  models  is  through  interpretive  structural  modeling  or 
ISM.  This  process  has  its  basis  in  mathematics,  particu¬ 
larly  in  graph  theory,  set  theory,  mathematical  logic,  and 
matrix  theory.  Specifically,  the  term  ISM  refers  to  the 
"systematic  iterative  application  of  graph  theory  notions 
such  that  there  results  a  directed  graph  (digraph)  represen¬ 
tation  of  complex  patterns  of  a  particular  contextual  rela¬ 
tionship  among  a  set  of  elements." 


Digraphs  conveniently  show  how  elements  interact  in 
terms  of  the  chosen  relationship.  They  communicate  that 


information  at  a  glance.  Consider  the  two  digraphs  shown  in 
Figure  4.2  using  the  relation  ’’costs  less  than”. 


The  elements  A,  B,  and  C  represent  physical  items  of 
interest.  Digraph  (a)  shows  that  C  costs  less  than  B  which 
is  less  than  A.  While  digraph  (b)  indicates  that  both  items 
B  and  C  cost  less  than  A,  the  costs  of  B  and  C  are  not  dis¬ 
tinguishable.  The  directed  line  lengths  have  no  meaning  as 
a  measure  of  strength  or  distance.  They  simply  represent 
existence  of  a  relation.  One  important  point  is  that  a 
digraph  is  unique  for  the  relationship  it  represents.  If 
the  chosen  relation  was  instead  "is  larger  than”,  a  dif¬ 
ferent  digraph  could  occur  with  A,  B,  and  C  on  entirely  dif¬ 
ferent  levels.  Therefore,  a  digraph  should  not  be  inter¬ 
preted  for  relations  other  than  the  one  used  to  form  it. 


4-14 


» 1 •C •  *r •  *  *  *vjr \ 


For  complex  systems,  such  graphs  are  many  times  diffi¬ 
cult  to  envision  a  priori  by  just  looking  at  the  whole  set 
without  a  systematic  method.  However,  the  interaction 
between  two  elements  is  easier  to  identify.  Thus  the  under¬ 
lying  principle  in  ISM  is  to  examine  interactions  between 
each  pair  of  elements  within  a  system  and  combine  the 
results  to  define  the  system  structure.  Prior  to  using  ISM 
an  analyst  must  then  establish  the  following  two  primitives: 
(1)  the  element  set  and  (2)  a  binary  contextual  relation.  It 
will  be  through  applying  the  contextual  relation  to  pairs  of 
elements  that  the  system  structure  will  be  defined.  An 
example  comparison  might  be  "element  I  is  preferred  to  ele¬ 
ment  J”.  Let  pi  represent  the  i  th  element  of  the  element 
set  P,  and  R  represent  the  contextual  relation.  The  nota¬ 
tion  P^ROj  will  be  used  to  mean  that  element  pj  is  related 
to  element  p^  by  the  relation  R.  and  PjIRpj  will  be  used 
to  mean  p.  is  not  related  to  pj  by  R. 


The  results  of  the  pairwise  comparisons  are  recorded  in 
matrix  form.  The  rows  of  the  array  represent  the  ”1”  ele¬ 
ments  and  the  columns  represent  the  ”J"  elements.  Thus  a 
100  element  system  is  represented  by  a  100  by  100  matrix. 

The  entries  in  the  matrix  are  determined  by  one  of  four 


direction)  from  element  J  to  element  1  and  not  in  both 
directions  (PjRp.  and  p^lRpj)  then  the  (j.i)  entry  is  a  1 
and  the  (i,j)  entry  is  a  0.  if  the  relationship  holds  in 
both  directions  (p^Rpj  and  PjRp^)  then  both  the  (i.j)  and 
(j.i)  entries  become  1.  Finally,  if  the  relationship  does 
not  hold  in  either  direction  (p.?RPj.  and  pjfRp^  then  both 
(i.j)  and  (j,i)  become  0.  The  remaining  entries  along  the 
diagonal  become  0  because  by  definition  a  digraph  contains 
no  loops  ( p • ! Rp •  for  all  p^  in  P).  After  the  matrix  entries 
are  identified  the  next  step  is  to  form  a  digraph  using  this 
information . 


A  fundamental  characteristic  of  a  digraph  is  that  ele¬ 
ments  are  grouped  in  "levels.”  Consider  a  particular  ele¬ 


ment  p.  and  how  it  relates  in  terms  of  the  chosen  relation 
to  the  other  elements  of  set  P.  There  is  a  set  of  elements 


L(P|)  such  that  P[RPj<  and  p^fRp^  for  each  element  p^  in 
L(Pi).  This  set  is  called  the  lift  set  of  element  pi  and 
does  not  contain  p.  .  Another  set  of  elements  Dip-)  contains 
elements  such  that  P|<RP[  and  Pj'RPfc  for  each  element  p^. 
This  set  is  called  the  drop  set  and  does  not  contain  p^ . 

The  remaining  set  of  elements  not  in  either  L(p.)  or  D(p-) 
are  part  of  the  vacancy  set  V(p.)  associated  with  pj.  Thus 
the  relations  between  p^  and  the  other  elements  of  P  are 
conveniently  structured  into  levels  as  shown  in  Figure  4.3. 
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Figure  4.3  Structural  Model  of  L(pj)  ,  D(p^)  and  V(pj) 


Each  of  the  three  sets  can  be  associated  with  a  posi¬ 


tion  in  the  digraph.  L(p^)  will  appear  on  levels  higher 
than  p^ ,  D(pj)  will  appear  on  levels  lower  than  p^.  and 
V(p-)  appear  in  unconnected  sections  (probably  on  similar 


levels).  Notice  that  the  top  elements  in  a  digraph  have  no 


L(  )  and  the  bottom  elements  have  no  D(  ).  The  levels  can 


then  be  found  by  identifying  the  top  set  of  elements  as 


those  with  no  L(  ),  putting  them  on  Level  one,  setting  them 


aside,  then  identifying  the  top  set  of  the  remaining  ele¬ 


ments,  putting  them  on  Level  two,  setting  them  aside,  and 


continuing  until  all  elements  are  assigned  a  level. 


The  mathematical  techniques  used  to  perform  this  parti¬ 


tioning  for  every  element  and  combine  the  results  are  too 


extensive  to  present  here  (refer  to  Sage,  1977:  119-128). 


After  elements  are  identified  with  levels  of  the  system 


digraph  the  directed  lines  that  represent  the  relationship 


between  elements  are  identified  from  the  entries  in  the 


matrix.  An  entry  of  1  in  the  (i.j)  position  represents  a 
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directed  line  running  from  element  1  to  element  J.  A  graph 
using  all  these  lines  is  correct,  but  unneccesar i 1 1 y  confus¬ 
ing.  If  the  relation  R  is  transitve,  many  of  the  directed 
lines  have  redundant  meaning  and  can  be  removed. 


A  relation  is  transitive  if  element  I  is  related  to 
element  J  and  element  J  is  related  to  element  K  necessarily 
implies  that  element  I  is  related  to  element  K.  For  exam¬ 
ple,  the  relations  ”1  is  larger  than  J”  and  ”1  is  more 
expensive  than  J”  are  transitive.  Because  of  the  ’’one  way” 
nature  of  transitive  relations,  the  ISM  generated  digraph 
representing  a  transitive  relation  cannot  have  cycles  or 
feedback  loops  as  demonstrated  in  Figure  4.4. 


♦ 

J 

1 

enforced  not  allowed 

Figure  4.4  Transitive  Digraphs  (Briggs,  1985) 
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To  summarize,  interpretive  strucural  modeling  provides 
a  means  to  transform  an  unclear  mental  model  into  a  graphi¬ 
cal  representation  of  structure.  This  structure  is  unique 
for  the  relationship  used  to  generate  it.  The  directed 
lines  of  the  digraphs  have  no  meaning  other  than  ’’the  rela¬ 
tionship  exists.”  Therefore,  the  ’’distance”  between  levels 
cannot  be  determined.  However,  this  forming  of  levels  can 
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be  interpreted  as  a  rank  ordering  of  the  elements  if  the 


relationship  used  is  transitive  and  all  elements  form  a  sin¬ 
gle  digraph.  This  ranking  interpretation  of  ISM  digraphs  is 
used  in  this  study  and  will  now  be  demonstrated. 

4 . 2 . 3 . 2  Pairwise  Comparisons  of  12  Feasible  SSS .  T o 
apply  the  previously  described  ISM  techniques  to  rank  the  12 
feasible  systems,  the  systems  are  treated  as  elements  and 
the  seven  objectives  are  used  to  develop  the  contextual 
relationships  for  pairwise  comparisons.  For  instance,  word 
relationships  like  "the  MLG+OSV+SB  system  has  higher  operat¬ 
ing  costs  than  the  MLG+OSV  system”  are  used.  The  seven  con¬ 
textual  relationships  intended  for  use  are  shown  in  Table 
4.3.  Notice  that  they  are  all  transitive  relations. 

Table  4.3 

Contextual  Relationships  for  System  Pairwise  Comparisons 

1.  System  1  "has  higher  operating  costs  than”  system  J. 

2.  System  1  "has  higher  initial  costs  than”  system  J. 

3.  System  1  "delivers  less  mass  to  the  satellites  than” 
system  J. 

4.  System  I  "has  lower  survivability  than”  system  J. 

5.  System  I  "is  less  flexible  than”  system  J. 

b.  System  I  "is  less  reliable  than”  system  J. 


7.  System  I  "improves  satellite  performance  less  than” 
system  J. 


Table  4.4 


full  Word  Equations  for  Contextual  Relationships 


1.  Operating  Cost  =  f (Mission  Dependant  Costs) 

+  F(Mission  Independant  Costs) 

FtMission  Dependant)  3  FtMission  Fuel  Costs) 

+  FtMission  Required  Parts)  \ 

FtMission  Fuel  Costs)  =  Ft#  of  Satellites) 

+  FtSubsystem  Propulsion  Methods)  I 

+  F(Satellite  Orbit) 

i 

I 

F(Mission  Independant)  =  F ( Ma i ntenance )  +  FtNon-  j 

mission  Fuel)  +•  F(Overhead) 

+  F ( Per sonne 1  )  j 

i 

I 

2.  Initial  Costs  *  FtR&D)  +  F(Purchase)  F  ( Dep  I  oyment ) 

FtR&D)  =  Ft#  of  Subsystem  Types  to  Develop)  +  F(New 
Technology  Required)  +  F(Complexity 
of  Subsystem  to  Develop) 

F(Purchase)  »  Ft#  of  Subsystem  Units) 

+  FtSize  and  Weight  of  Each  Unit) 

+  F(Co«plexity  of  Subsystem) 

j 

t 

F ( Dep I oyment )  =  F ( #  of  Subsystem  Units  to  Deploy) 

+  F(Size  and  Weight  of  Each  Unit) 

+  F(Unit  Deployed  Orbit)  j 

j 

3.  Mass  Delivered  to  Satellites  =  F(#  of  Subsystem  Units)  i 

+  F(Launch  Vehicle  Payload  Capacity) 

-*•  F(Delivery  Rate  of  Launch  Vehicle)  | 
-*•  F(Service  Vehicle  Payload  Capacity) 

+  F(Delivery  Rate  of  Service  Vehicle) 

1 

4.  Survivability  =  F(#  of  Subsystem  Units) 

-*•  F(Abiliy  to  Avoid  Hostile  Action) 

5.  Flexibility  =  F(Ability  to  Deal  with  Unplanned  Maint.) 

+■  F(Ability  to  Accomodate  Changes) 

6.  Reliability  =  F ( H  of  Parallel  Subsystems) 

7.  Satellite  Performance  Improvement  =  Ft  Increased 

Satellite  Availability)  +  F ( 1 ncreased 
Satellite  Dependability)  FtAbility  j 
to  Upgrade  Satellite)  i 


r 


Due  to  the  varying  types  and  numbers  of  subsystems 
comprising  each  system,  it  is  not  immediately  obvious  how 
some  of  the  word  relationships  hold.  Therefore,  the  word 
equations  shown  in  Table  4.4.  are  formulated  to  initially 
identify  factors  or  functions  (  indicated  by  F(words)  )  of  a 
SSS  that  contribute  to  achieving  each  objective.  These  in 
essence  define  the  models  and  establish  the  gross  level  of 
detail  used  for  the  pairwise  comparisons  (remember  the  rea¬ 
son  for  doing  the  comparisons  is  to  reduce  quickly  the 
number  of  SSS  to  be  modeled).  However,  to  use  some  of  the 
factors  would  require  more  detailed  system  models.  For 
instance,  under  operating  costs,  the  magnitude  of  the  effect 
of  mission  required  parts,  subsystem  propulsion  methods, 
number  of  satellites,  and  orbits  of  the  satellites  can  not 
be  determined  for  each  SSS  at  this  level  of  detail.  In  fact, 
factors  are  not  used  that  require  knowledge  of  a  physical 
realization  of  a  subsystem.  Thus,  the  comparison  of  mass 
delivered  to  satellites  is  non-discriminant  between  systems 
because  it  requires  knowledge  about  the  payload  capacity  and 
usage  rate  of  each  subsystem.  Similar  knowledge  require¬ 
ments  preclude  the  comparisons  using  initial  costs  and 
satellite  performance  improvement.  Therefore,  all  systems 
are  assumed  to  be  comparable  in  initial  costs,  mass- 
delivered  to  sattelites,  and  satellite  performance  improve¬ 
ment  . 
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The  remaining  contextual  relations  associated  with  the 
objectives  of  low  operating  costs,  high  survivability,  high 
flexibility,  and  high  reliability  are  used  for  the  actual 
pairwise  conpari sons.  The  factors  used  to  determine  the 
results  of  these  comparisons  are  shown  in  Table  4.5. 

Table  4 .5 

Reduced  Word  Equations  for  Contextual  Relationships 

1.  Operating  Cost  =  F(Mission  Fuel  Costs)  +  F(Main- 

tenance)  +  F ( Mon-mi ss ion  Fuel) 

+  F(Overhead)  +  F(Personnel) 

2.  Survivability  =  F(#  of  Subsystem  Units) 

+  F(Abiliy  to  Avoid  Hostile  Action) 

3.  Flexibility  =  F(Ability  to  Deal  with  Unplanned  Maint.) 

+  F(Ability  to  Accomodate  Changes) 

4.  Reliability  =  F(#  of  Parallel  Subsystems) 

Of  these  remaining  factors,  some  are  easy  to  compare  on 
a  system  level  when  the  two  SSS  are  vastly  different.  For 
instance,  a  SSS  composed  of  one  launch  system  and  one  ser¬ 
vice  system  is  less  reliable  than  one  made  of  all  five  sub¬ 
systems  because  of  the  multiple  number  of  launch  systems  in 
the  second  SSS.  But  when  the  number  and  types  of  subsystems 
are  similar,  then  the  individual  subsystems  must  be  compared 
to  determine  how  the  relationship  applies  to  the  whole  sys¬ 
tem.  To  be  consistent,  the  assumptions  shown  in  Table  4.6 
were  established  prior  to  performing  the  comparisons. 


Table  4.6 


Assumptions  for  Pairwise  Comparisons 


o  Operating  Costs 


Mission  Fuel: 

MLG 

< 

FLG 

FHG 

< 

MLG 

Maintenance : 

MLG 

< 

FLG 

Overhead : 

MLG 

= 

FLG 

MLG 

> 

SB 

SB 

= 

FHG 

Personne 1 : 

MLG 

= 

FLG 

SB 

* 

FHG 

o  Survi vabi 1 i ty 

Mobile  launch  systems  >  Fixed  launch  systems 


Increases  with  number  of  subsystems  (fewer  choke 
points,  single  point  failure  concept) 


o  F lexibi 1 ity 

Mobile  launch  systems  >  Fixed  launch  systems 
Increases  with  type  and  number  of  subsytems 
o  Rel iabi I ity 

Increases  with  type  and  number  of  subsytems 


o  At  this  level  of  detail.  Initial  Costs,  Mass  Delivered 
to  Satellites,  and  Satellite  Performance  Improvement 
are  considered  comparable  between  SSS . 


To  demonstrate  the  logic  used,  consider  the  eleven 
pairwise  comparisons  (in  terms  of  operating  costs)  between 
the  FLG+OSV  system  and  each  of  the  other  systems.  The 
results  are  shown  in  Table  4.7. 
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Table  4.7 


Sample  Results  of  Pairwise  Comparisons 


> 

System 

I 

| 

t 

Operating  Costs 

Factors 

System 

J 

roa  i  nt 

over- 

head 

person- 
ne  1 

FLG^OSV 

> 

> 

= 

= 

MLG+OSV* 

”  TIE 

> 

= 

= 

< 

<w 

FHG  i-FLG+OSV 

99  * 

> 

= 

= 

< 

<W 

FLG  +  ilLG  +  OSV 

99  * 

> 

< 

= 

< 

< 

FHG+MLG-rOSV 

* 

> 

< 

= 

<< 

<< 

FLG  +  ilLG  +  FHG-rOSV 

”  * 

> 

< 

< 

< 

< 

FLG+SB+OSV 

”  * 

> 

= 

< 

< 

MLG+SB+OS V 

”  » 

> 

< 

< 

< 

= 

FHG+FLG+SB+OSV 

”  * 

> 

< 

< 

< 

< 

!  FLG+MLG  +  SB+OS V 

l 

99  * 

> 

3 

< 

<w 

!  FHG+MLG^SB^-OSV 

99  * 

i 

> 

< 

< 

< 

< 

] 

!  FHG  +  FLG+MLG-SB 
;  +OSV 

i- 


Notes : 

=  =  "1”  has  about  the  same  (ops  cost  factor)  as  ”J” 

j  >  =  ”1”  has  greater  (ops  cost  factor)  than  ”J” 

,  <  =  ”1”  has  less  (ops  cost  factor)  than  ”J” 

{  >W  =  ”1”  has  slightly  greater  (ops  cost  factor)  than  ”J 

<W  =  ’’I”  has  slightly  less  (ops  cost  factor)  than  ”J” 

>>  =  ”1”  has  much  greater  (ops  cost  factor)  than  ”J” 

<<  =  ”1”  has  much  less  (ops  cost  factor)  than  ”J” 

*  =  marks  system  that  is  considered  having  the  lower 
operating  costs  between  systems  1  and  J. 


Two  systems  are  compared  in  terms  of  each  of  the  five 
operating  costs  factors  of  mission  fuel,  maintenance,  non¬ 
mission  fuel,  overhead,  and  personnel.  The  response  is 
recorded  under  the  appropriate  column  using  arrows  to  point 


to  the  lower  costing  system,  or  an  equal  sign  to  indicate 
comparable  costs.  Additionally,  the  arrows  indicate  the 
strength  of  the  cost  difference  by  the  following  convention: 
a  ’W’  to  the  right  of  the  arrow  indicates  a  weak  difference, 
a  single  arrow  indicates  a  nominal  difference,  and  a  double 
arrow  is  a  strong  difference.  The  aggregate  of  these 
responses  determines  which  of  the  two  systems  is  identified 
to  have  lower  operating  costs.  This  system  is  marked  with 
an  asterisk,  and  if  neither  system  is  identified  then  the 
word  TIE  is  placed  in  the  System  I  column.  For  instance, 
consider  the  first  comparison.  Since  the  OSV  is  common  to 
both  systems,  it  is  not  a  discriminator  in  any  factor  (this 
is  true  in  all  SSS  pairwise  comparisons).  Invoking  the 
assumptions  of  Table  4.6,  the  MLG-t-OSV  system  is  lower  in  the 
operating  cost  factors  of  mission  fuel  and  maintenance,  and 
neither  system  is  lower  in  the  other  three  factors.  There¬ 
fore,  the  MLG-t-OSV  system  is  identified  as  having  lower 
operating  costs  than  the  FLG+OSV  system.  Thus,  the  state¬ 
ment  "the  FLG-t-OSV  system  has  higher  operating  costs  than  the 
MLG+OSV  system”  is  true. 

An  interactive  computer  program  is  used  to  enter  the 
results  of  the  pairwise  comparisons  of  Operating  Costs,  Sur¬ 
vivability,  Flexibility,  and  Reliability  and  then  perform 
the  subsequent  matrix  ’’partitioning”  referred  to  in  the  pre¬ 
vious  section  describing  interpretive  stuctural  modeling 
(ISM).  The  output  identifies  the  level  number  of  each  sys- 
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tern  in  the  ISM  digraph  (hierarchy  tree)  representing  the 
relationship  chosen.  Figure  4.5  shows  the  digraph  for  the 
relation  ’’lower  operating  costs”. 

Clements:  12  Feasible  SSS  (A  through  L) 

Relation:  Lower  Operating  Costs 


i 


2  8 


(Digraph)  (Level  #) 


Figure  4.5  Operating  Costs  Digraph  with  Level  #’s 


Table  4.8  shows  a  listing  of  the  12  feasible  systems 
and  the  number  of  their  associated  level  in  each  of  the  four 
ISM  digraphs.  These  level  numbers  represent  the  order  of  the 
ranking  but  do  not  indicate  relative  strength  of  objective 
achievement.  For  instance,  under  operating  costs,  becuase 
system  G  is  on  level  3  it  is  less  costly  than  system  L  on 
level  1.  However,  this  does  not  necessarily  indicate  that 
system  G  is  one  third  as  costly  as  system  L.  These  numbers 
are  then  treated  as  performance  measures  or  indicies  (Pis) 
to  be  used  in  applying  the  concept  of  Pareto  optimality  or 
non-dominance . 


V, 


Table  4 . 8 


Ranking  of  SSS  by  Pis 


C  C 
0  0 


SYSTEM 


A.  FLG+OSV 

B.  MLG+OSV 

C.  FHG+FLG+OSV 

D.  FLG+MLG+OSV 

E.  FHG+MLG+OSV 

F.  FLG+MLG+FHG+OSV 

G.  FLG+SB+OSV 

H.  MLG+SB+OSV 

I .  FHG+FLG+SB+OSV 

J.  FLG+MLG+SB+OSV 

K.  FHG+MLG+SB+OSV 

L.  FHG+FLG+MLG+SB+OSV 


Notes  '• 


-  1  indicates  lowest  achievement  of  objective 

-  Numbers  are  for  comparison  within  columns 
only,  not  between  them. 

-  Numbers  for  Initial  Costs,  Mass  Delivered  to 
Satellites,  and  Satellite  Performance 
Improvement  are  not  shown  for  figure 
clarity  (assumed  equal  for  all  SSS). 


4. 2. 3. 3  Selecting  4  SSS  to  Model.  Next  the  concept  of 


Pareto  optimality  (Changkong  and  Ha imes , 1983 : 1 1 4 ) is  used  to 


identify  a  non-domi nated  solution  set  (NDSS)  of  candidate 


systems.  The  vectors  of  Pis  for  all  systems  are  compared  in 


a  pairwise  manner.  A  system  is  considered  dominated  by 


anocher  system  if  at  least  one  performance  measure  of  the 


second  system  is  strictly  better  than,  and  the  remaining 


performance  measures  of  the  second  system  are  at  least  equal 
to  (never  less  than)  those  of  the  first  system.  The  dom¬ 
inated  systems  are  removed  and  the  remaining  systems  form 
the  NDSS.  For  example  consider  the  five  system  set  shown  in 
Figure  4.6.  The  FHG+MLG+SB+OSV  system  is  a  non-dominated 
solution  because  none  of  the  bracketed  systems  dominate  it. 
In  fact,  when  the  other  seven  systems  are  included  in  the 
set,  the  FHG+MLG+SB+OSV  system  is  still  a  member  of  the 


NDSS. 


1 


SYSTEM 


FLG+SB+OSV 

MLG+SB+OSV 

FHG+FLG+SB+OSV 

FLG+MLG+SB+OSV 

FHG+MLG+SB+OSV 
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Figure  4.6  Non-Domi nated  Solution  Example 


The  NDSS  for  the  12  feasible  systems  consisted  of  three 
systems.  They  contained  two,  four,  and  five  subsystems.  It 
is  felt  that  an  additional  system  made  of  three  subsytems 
would  better  represent  the  span  of  the  12  feasible  systems. 
The  ranked  values  of  the  chosen  system  ( FHG+MLG+OSV )  are  in 


the  middle  range  of  the  rankings.  The  boxed  systems  in 


Figure  4.7  are  the  selected  four  systems  to  be  further 
mode  1 ed . 
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FHG+MLG+OSV! ** 
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*Non_domi nated  solution 
""Dominated  solution  retained  to  represent 
SSS  made  of  3  subsystems 


Figure  4.7  Final  Four 


This  section  presented  the  qualitative  (first  order) 
modeling  and  analysis  processes  used  to  select  representa¬ 
tive  systems  for  equation  development.  To  quickly  reduce  the 
number  of  candidates,  simplifying  assumptions  were  made  to 
emphasize  the  differences  among  the  systems.  The  following 
section  will  describe  the  analytical  model  equations 
representing  the  selected  systems.  The  analysis  of  one  of 


these  models  is  the  subject  of  Chapter  V. 


4.3  Analytical  Models 


Following  completion  of  modeling  at  a  conceptual  or 
qualitative  level,  equations  can  be  developed  to  form 
analytical  models  that  represent  an  increased  level  of 
detail.  These  analytical  (quantitative)  models  describe  the 
real-world  behavior  of  a  system  and  are  valid  to  the  extent 
that  the  equations  represent  the  conditions  or  limits 
defined  by  the  environment.  The  form  of  the  model  equations 
must  be  such  that  the  analyst  can  differentiate  between  can¬ 
didate  designs  and  predict  the  relative  merits  of  each.  The 
statespace  model  form  meets  these  criteria  ( UeW i spe 1  are , 
1984)  and  is  used  in  this  study.  A  description  of  the  gen¬ 
eral  statespace  model  form  will  be  presented  in  section 
4.3.1.  This  is  followed  by  a  discussion  in  section  4.3.2 
about  the  general  characteristics  of  a  Satellite  Servicing 
System  (SSS).  It  includes  how  the  characteristics  are  incor¬ 
porated  into  the  equations  used  to  model  system  and  subsys¬ 
tem  interrelationships  within  the  potential  models. 

At  the  level  of  detail  achieved  by  the  model  equations, 
no  differentiation  between  the  MLG  and  the  FLG  launch  sys¬ 
tems  could  be  identified.  Therefore,  the  terms  MLG  and  FLG 
will  be  deleted  and  the  simple  term  low-G  (LG)  launch  system 
will  be  used  for  the  rest  of  the  analytical  model  discus¬ 
sions.  This  results  in  two  of  the  potential  SSS  systems 
identified  in  the  previous  section  (the  SB  +  FHG+MLG-'-OSV  sys¬ 
tem  and  the  SB+FHG+MLG+FLG+OSV  system)  collapsing  into  the 


SB+F HG+LG+OSV  system.  The  three  potential  SSS  systems  are 
now  the  LG^-OSV  .  FHGi-LG^OSV  .  and  the  SB+FHG-’-LG^-OSV  systems. 


4.3.1  Statespace  System  Modeling  (Clark  and  UeWispelare 


198o ) .  A  statespace  model  is  a  mathematical  description  of  a 
system.  For  a  linear  model  the  equations  are  normally 
grouped  in  matrix  form  as  shown'. 


Z  =*  AX  +  BU’  f 
X_  =  CX  ♦  DU ’  +  K2 

tx  u  <  yx 
tu-  <-  IT  <  V 


(4.1) 


(4.2) 


(4.3) 


(4.4) 


where  Z_  is  an  pxl  vector  of  performance  i nd i ces ( P l ’ s  )  .  X_  is 
an  nxl  vector  of  state  variables.  JJ’  is  an  mxl  vector  of 
control  variables,  K.^  and  Ji2  are  constant  vectors  of  dimen¬ 
sion  pxl  and  nxl  respectively,  and  and  Lu .  are  vectors  of 
lower  bounds  and  _U  and  U„ •  are  vectors  of  upper  bounds  for 
the  system  variables.  A,  B.  C,  and  D  are  matrices  that  form 
the  system  equations.  Even  though  the  above  equations  sug¬ 
gest  a  linear  form,  a  general  statespace  model  is  not  res¬ 
tricted  to  equations  that  are  linear  in  X  and  JJ. 


For  this  study  the  system  equations  are  nonlinear  and 
can  be  represented  in  the  following  form: 


Z  =  f(X.  U) 


(4.5) 


1  =  *<x.  H) 


(4.6) 


L  ( X .  U)  <  X  <  U„(X.  U) 


(4.7) 


where  Z  is  a  pxl  vector  of  Pi’s,  X_  is  a  nxi  vector  of  state 
variables,  and  t  is  a  kxl  vector  of  exogenous  variables. 

The  exogenous  variables  include  the  previously  mentioned 
control  variables,  U_’ ,  and  constant  vectors  (K^  and  K2 > . 

The  functions  f(...)  and  g(.,.)  represent  nonlinear  rela¬ 
tions  between  the  Pi’s  and  the  state  and  exogenous  vari¬ 
ables.  L  (...)  and  l)'  (  .  ,  .  )  are  functions  of  the  state  and 
— x  — X 

exogenous  variables  that  generate  vectors  of  1  over  and  upper 
bounds  on  the  state  variables. 

Hereafter  Eqs  (4.5),  (4.6)  and  (4.7)  will  be  referred 
to  as  the  performance  indice  (PI)  equations,  state  (equal¬ 
ity)  equations,  and  constraint  (inequality)  equations, 
respectively.  The  state  and  constraint  equations  can  be 
thought  of  as  representing  the  physical  model;  while  Eq 
(4.5)  represents  the  performance  measure  of  the  physical 
system  (ie  the  PI  model).  Notice  that  all  the  equations  are 
functions  of  state  variables  which  describe  the  system  being 
modelled,  and  exogenous  variables  which  describe  the 
environmental  or  external  conditions  to  which  the  model  is 
subjected . 

The  state  variables  in  the  column  vector  _X.  are  system 
discriptors.  These  variables  are  parameters  used  to 
describe  a  given  system  and  distinguish  it  from  similar  sys¬ 
tems;  possible  choices  include  the  size  and  number  of  each 
subsystem,  payload  mass,  and  the  number  of  crew  members 
required.  An  analyst  (designer)  has  a  great  deal  of  freedom 
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in  choosing  which  system  characteristics  wilt  be  used  as 


state  variables.  However,  whether  they  are  physical  charac¬ 
teristics  or  convenient  abstract  mathematical  descriptors, 
all  state  variables  must  meet  two  criteria: 

1.  A  state  variable  must  interrelate  with  another  system 
variable  or  directly  affect  a  performance  index. 

2.  The  feasible  region  of  the  state  variable  must  be  large 
enough  to  allow  distinctly  different  real izatons  of  the 
var iab 1 e . 

The  first  restriction  is  important  because  the  candi¬ 
date  systems  are  judged  in  terms  of  the  performance  meas¬ 
ures.  Therefore,  a  state  variable  must  directly  or 
indirectly  contribute  to  the  PI  values.  As  a  counter  exam¬ 
ple,  consider  using  the  color  of  a  vehicle  as  a  state  vari¬ 
able.  While  color  is  a  valid  descriptor,  it  will  not  con¬ 
tribute  to  achieving  such  design  objectives  as  increased 
payload  capacity  or  smoother  ride. 

The  second  restriction  is  to  ensure  that  the  state 
variables  do  in  fact  provide  a  mechanism  to  distinguish 
between  candidate  solutions.  If  the  feasible  region  defined 
by  the  constraints  is  too  small  to  meet  the  second  state 
variable  criterion,  then  the  system  characteristic  is  essen¬ 
tially  fixed  and  becomes  a  required  design  parameter. 

Exogenous  variables  are  similar,  but  not  identical,  to 
control  variables  in  the  linear  form.  In  the  linear  case 
control  variables  are  those  input  variables  which  "drive" 
the  state  variables  to  a  given  configuration.  for  instance. 
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in  a  preliminary  missile  design  study  (Clark  and 


•rj 


DeWispelare.  1985b),  cruise  velocity  is  a  control  variable. 
To  achieve  a  given  cruise  velocity,  the  propulsion  system 
must  produce  some  threshold  thrust  relative  to  the  total 
drag  of  the  missile.  Therefore,  the  state  variable  thrust 
and  the  state  variables  directly  related  to  drag  are  forced 
via  a  state  equation  by  the  control  variable  cruise  velocity 
to  an  appropriate  configuration  which  allows  the  required 
cruise  velocity  to  be  acheived. 

In  the  non-linear  statespace  form  the  exogenous  vari¬ 
ables  are  defined  as  those  variables  (usually  set  to  con¬ 
stant  values)  that  represent  the  effects  of  the  environment 
on  the  system  being  modeled.  These  include  control  variables 
and  other  constant  variables  that  affect  system  operation 
and  performance.  Not  only  can  exogenous  variables  act  as 
inputs  to  the  model,  such  as  the  number  of  satellites  and 
their  required  service  interval,  they  can  also  represent 
bounds  on  the  state  variables,  such  as  minimum  and  maximum 
time  between  LG  launches  at  one  site. 

The  state  equations  represent  relations  between  the 
state  and  exogenous  variables.  For  this  study  these  equa¬ 
tions  represent  the  relations  that  exist  between  the  dif¬ 
ferent  subsystems  of  a  SSS ,  or  the  relationships  between 
internal  states  of  an  individual  subsystem.  As  one  state 
variable  changes  value,  other  variables  will  also  change 
value  to  satisfy  the  state  and  constraint  equations. 
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The  constraint  equations  represent  limits  on  both  the 
values  and  functions  or  interactions  that  state  variables 
can  attain.  These  constraints  usually  represent  the  techno¬ 
logical  or  physical  limitations  on  the  system.  The  realiz¬ 
able  values  of  the  state  variables  form  the  feasible  region 
of  the  statespace. 

The  PI  equations  represent  the  response  of  the  system 
as  the  variables  (X  and  sometimes  1) )  are  varied  over  the 
feasible  region  of  interest.  In  other  words,  the  Pi’s  meas¬ 
ure  the  model  performance  level  for  a  given  realization 
(state)  of  the  system  and  provide  criteria  to  select  the 
best  system.  The  PI  values,  Z,  are  generated  from  equations 
containing  state  and  exogenous  variables  combined  in  such  a 
way  as  to  yield  a  measure  of  achievement  of  the  design 
ob ject i ves  . 

Figure  4.8  graphically  depicts  the  interactions  of  the 
system  variables  (X  and  U)  with  the  physical  and  PI  models. 

A  given  candidate  SSS ,  represented  by  a  realization  of  state 
vector  X’,  is  checked  for  feasibility  by  the  physical  model. 
If  the  physical  model  equations  are  satisfied,  then  the 
state  vector,  X’,  is  feasible  and  redesignated  as  X.  This 
vector  (X)  is  then  used  to  calculate  the  level  of  perfor¬ 
mance  for  the  candidate  SSS. 
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Figure  4.8  Non-Linear  Statespace  Model  Diagram 

Once  the  system  model  equations  have  been  cast  into  a 
statespace  form  multi-objective  optimization  theory  (MOOT) 
techniques  can  be  applied  to  solve  for  optimal  system  reali¬ 
zations.  But  before  the  MOOT  process  for  this  effort  is 
discussed  (see  Chapter  V),  a  qualitative  discussion  of  the 
non-linear  system  equations  is  presented.  It  is  not  the 
purpose  of  the  next  section  to  give  detailed  derivations  for 
each  equation.  Rather,  the  goal  is  to  present  the  assump¬ 
tions  and  system  characteristics  that  the  model  equations 


represent . 


4.3.2  Model  Description.  Due  to  the  differences  in  each 

of  the  potential  servicing  systems,  one  comprehensive  model 
for  the  three  systems  is  not  possible.  Therefore,  each  sys¬ 
tem  is  modeled  individually  starting  with  the  simplest  sys¬ 
tem  (LG+OSV)  and  building  upon  it  to  form  the  more  complex 
systems.  A  detailed  listing  of  the  different  model  equa¬ 
tions  is  in  Appendix  D,  the  model  variables  are  in  Appendix 
E,  and  the  intermediate  (algebraic  simplification)  equations 
are  in  Appendix  F.  References  for  all  equations  and  vari¬ 
ables  can  be  found  in  the  appendices  listed  above.  For  the 
readers  convenience  a  listing  of  the  state  variables  is  in 
Table  4.9  and  a  listing  of  model  constants  (important  exo¬ 
genous  variables)  is  in  Table  4.10. 


Table  4 .9 

Subsystem  State  Variables  (SV) 


SV 

DESCRIPTION 

UNITS 

RANGE 

X500 

ORBITAL  SERVICING  VEHICLE 
Number  of  OSV  systems 

number 

0-inf 

X501 

8  of  OSV  mi ss ions / t i me 

8  /  hr 

0-  i  nf 

X510 

OSV  Payload  mass 

kg 

0-inf 

X525 

OSV  stucture  mass 

kg 

0-inf 

X526 

Mass  of  propulsion  fuel 

kg 

0-inf 

X545 

OSV  reliability 

number 

01 

X555 

OSV  crew  s i ze ( 8-peop 1 e ) 

number 

0-inf 

X560 

Number  of  satelittes 
serviced  per  OSV  mission 

number 

0-inf 

X5b  1 

Mass  delivered  to  a 
satellite  per  service 

kg 

0  -  i  n  t 

X5b5 

Number  of  waiting  orbits(n) 

number 

l  -  inf 
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Table  4.9  Continued 


i 

sv 

DESCRIPTION 

UMTS 

RANGE 

X300 

LOW-G  LAUNCHER 

Number  of  LG  systems 

number 

O-inf 

X30  1 

8  LG  m i ss ions / t i me 

8  /  hr 

O-inf 

X310 

Payload  mass  per  launch 

kg 

O-inf 

X320 

Number  of  launch  sites 

number 

O-inf 

X325 

Vehicle  structure  mass 

kg 

O-inf 

X326 

Mass  of  propulsion  fuel 

kg 

0-  inf 

X330 

LG  downtime  between  missions 

hr 

168- inf 

X335 

Time  between  launches  at 
a  specific  launch  site 

hr 

24-8760 

X345 

LG  reliability 

number 

0  1 

X3b0 

Rendezvous  altitude 

km 

1 85- i nf 

X370 

Number  of  LG  stages 

number 

1  -  inf 

X100 

FIXED  HIGH-G  LAUNCHER 

8  FHG  launches/time 

number 

O-inf 

XI 10 

FHG  payload  mass/launch 

kg 

O-inf 

XI 20 

Number  of  launch  sites 

number 

0-  i  nt 

X  1 35 

Time  between  launches 
at  a  specific  site 

hr 

24- inf 

X400 

SPACE  BASE 

8  of  space-bases 

number 

O-inf 

X415 

SB  crew  size  (8people) 

number 

O-inf 

X420  SB  mass  storage  capacity 


kg  O-inf 


X425 


SB  structure  mass 


kg 


O-inf 


Tab  1 e  4.10 


Exogenous  (Constant)  Variables  ( li ) 


u 

DESCRIPTION 

UNITS 

VALUE 

U1 

SATELLITE  CONSTELLATION  INPUTS 
Average  satellite  altitude 

km 

800 

U2 

#  of  sate  1 1 i tes 

number 

144 

U6 

Satellite  service  interval 

y  rs 

3 

U  1  4 

Percent  of  satellite  required 
mass  requirng  low-G  launch 

% 

25 

U 1 8 

OSV  Constant  inputs 

Mass  of  OSV  guidance  equipment 

i 

kg 

i 

200 

li  19 

OSV  mass  needs/mission 

kg  i 

i 

100 

U22 

Cost/unit  of  OSV  fuel 

S/kg  ! 

0.32 

1)24 

OSV  isp 

hr 

0. 14 

1)25 

LG  CONSTANT  INPUTS 

LG  to  OSV  mass  transfer  rate 

* 

kg/hr  j 

800 

U26 

OSV  to  Satellite  transfer  rate 

kg/hr 

400 

U31 

Cost/unit  of  LG  fuel 

S/kg 

0.32 

1)33 

LG  ISP 

.  1 

hr  1 

0.11 

1)35 

LG  to  SB  mass  transfer  rate 

kg/hr 

i 

900 

1)75 

PEOPLE  RELATED  INPUTS 

SB  life  support  requirements 
per  person-time 

1 

kg 

0.20 

U7b 

OSV  life  support  requirements 
per  person-time 

kg 

0  .  b4 

1)77 

Maximum  people  time  in  space 
before  rotation 

weeks 

13 

078 

Cost/ man-t ime 

S/ man  hr 

1000 

079 

Cost/man-year  used  in 
cost  equations 

i 

| 

!  S/man-yr 

125000 
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Table  4.10  Continued 


\  l) 

DESCRIPTION 

UMTS 

VALUE 

j 

U  1  1  1 

FHG  CONSTANT  INPUTS 

Cost  of  earth  based  energy 

5/ watt-hr 

0.00115 

111  14 

Cost  of  FHG  apogee  fuel 

$/  kg 

0.32 

U121 

Isp  of  apogee  burn  fuel 

hr 

0.09 

lil  29 

SB  CONSTANT  INPUTS 
%  of  SB  structure  mass  used 
for  fuel  calculation 

%/yr 

2 

U  i  30 

SB  safty  level 

month 

1 

U 1 32 

%  of  SB  structure  mass  for 
parts  calculation 

%/yr 

10 

U 1 33 

SB  structure  mass  to  mass 

storage  capacity  ratio 

none 

1 .0 

U 1 34 

Cost  of  SB  parts 

5/kg 

100 

U 1 38 

SB  deployment  cost 

5/  kg 

20000 

11 1 39 

SB  fuel  cost 

5/kg 

[  0.32 

The  discussion  that  follows  gives  a  description  of  the 
assumptions,  ideas,  and  relationships  expressed  in  the 
detailed  model  equations  listed  in  Appendix  D.  All  three 
models  are  discussed  simultaneously;  therefore,  if  a  partic 
ular  model  of  interest  has  a  specific  subsystem  as  a  com¬ 
ponent,  the  discussion  pertaining  to  that  subsystem  applies 
For  example,  if  the  model  of  interest  is  the  LG+OSV  model, 
then  the  FHG  and  SB  discussions  do  not  apply.  The  detailed 
models  in  Appendix  l)  start  with  a  listing  of  equations 
applicable  to  all  potential  models,  followed  by  three  sec¬ 
tions  listing  additional  equations  applicable  to  each 
specific  model  of  interest. 
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4.3.2. 1  Operating  Scenarios.  Many  different  SSS  realiza¬ 
tions  are  possible  using  the  descriptions  of  the  three  can¬ 
didate  SSS  from  section  4.2.  Potential  operating  scenarios 
are  defined  to  assist  in  the  model  equation  development,  and 
help  identify  important  relationships  to  be  modeled.  There¬ 
fore,  the  following  scenario  descriptions  must  be  kept  in 
mind  when  evaluating  the  validity  of  the  equations. 

Figure  4.9  displays  a  scenario  for  the  LG+OSV  system. 

In  this  scenario  the  LG  is  launched  from  Earth  to  a  specific 
OSV  rendezvous  altitude  (parking  orbit).  The  OSVs  are  then 
refurbished  and  resupplied  from  the  LG.  The  OSVs  then 
depart  on  another  servicing  mission  and  the  LG,  emptied  of 
payload,  returns  to  Earth  for  refurbishment,  resupply,  and 
relaunch.  In  this  model  one  LG  could  service  several  OSVs 
or  multiple  LGs  could  service  a  single  OSV. 


Figure  4.9  LG+OSV  Operating  Scenario 
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The  FHG  +  LG-rOSV  operating  scenario  (Figure  4.10)  is 
similiar  to  the  LG-i-GSV  operating  scenario.  The  only  differ¬ 
ence  is  that  the  FHG  vehicle  is  also  launched  into  the 
LG+OSV  rendezvous  orbit  and  the  OSVs  are  now  resupplied  from 
both  LGs  and  FHGs.  An  important  point  to  remember  is  that 
by  definition  the  FHG  can  only  carry  mass  that  can  withstand 
a  high-G  launch.  Therefore,  the  LG  must  carry  as  a  minimum 
all  the  mass  that  must  be  iow-G  launched. 


Figure  4.10  FHG+LG+OSV  Operating  Scenario 

Figure  4.11  displays  a  possible  SB+FHG+LG+OSV  operating 
scenario.  In  this  scenario  all  LGs  and  FHGs  are  launched  to 
the  SB  orbit.  The  LGs  transfer  their  entire  payload  to  the 
SB  and  return  to  Earth  for  resupply,  refurbishment,  and 
relaunch.  The  FHG  could  be  designed  to  rendezvous  with  the 
SB,  or  it  could  rendezvous  with  the  OSVs  and  transfer  the 
high~G  payload  directly  to  an  OSV .  The  OSVs  must  link  up 
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with  the  SB  to  pickup  low-G  launched  parts.  The  SB  is  con¬ 
sidered  to  be  a  mass  storage  facility  and  temporary  personel 
quarters  for  OSV  crew  members  arriving  on  the  LG. 


Figure  4.11  SB+FHG-*-LG-*-OSV  Operating  Scenario 


4. 3. 2. 2  Satellite  Constellation.  The  amount  of  mass  a  SSS 
must  deliver  to  orbit  is  driven  by  the  satellite  constella¬ 
tion  being  serviced.  To  represent  this  driving  input  the 
satellite  model  equations  should  take  into  account  the  dif¬ 
ferent  orbits  and  inclinations,  the  frequency  of  service, 
and  the  amount  and  kind  of  mass  required  by  each  satellite. 
However,  the  true  nature  of  the  satellite  conste 1 1  at  ion ( s ) 
to  be  serviced  by  the  SSS  under  study  is  not  known.  There¬ 
fore,  rather  than  model  the  performance  of  a  SSS  to  meet  a 
specific  demand,  a  Performance  Index  maximizing  the  actual 


mass  deliverd  by  the  SSS  is  modeled. 


From  this  perspective,  the  delivery  capability  of  dif¬ 
ferent  SSS  configurations  can  be  compared  using  a  simple 
constellation.  The  benefit  of  using  a  simple  constellation 
is  that  the  orbital  mechanics  equations,  describing  how  a 
servicing  vehicle  travels  from  satellite  to  satellite,  are 
manageable  (see  Appendix  G).  These  equations  become 
increasingly  complex  with  increasing  number  of  orbits  and 
inclinations.  The  impact  of  this  simplification  on  the 
results  will  be  discussed  in  section  V.  For  this  study,  the 
satellite  constellation  consists  of  144  satellites  ”8  Satel¬ 
lites"  (U2)  equally  spaced  about  one  circular  orbit  at  an 
altitude  of  800km  "Average  Satellite  Altitude"  (Ul)  and  zero 
degree  inclination.  All  satellites  will  be  given  the  same 
amount  of  mass  "Mass  delivered  to  a  Satellite"  (X561)  at  a 
fixed  service  interval  "Satellite  service  interval”  (U6). 
They  will  be  serviced  in  a  sequential  order  about  their 
orbit.  No  on-demand  servicing  alternatives  are  considered. 


4. 3. 2. 3 


ion .  1  n 


order  to  adequately  compare  the  different  SSS  models  a  com¬ 
mon  set  of  Pi's  must  be  defined.  The  Pi’s  must  measure  the 
same  characteristics  in  each  model  and  should  be  understood 
by,  and  important  to,  the  decision  maker.  In  other  words. 


the  scalar  value  (PI)  generated  by  the  equations  represents 


a  level  of  achievement  of  the  objectives  (the  seven  identi¬ 
fied  previously)  by  a  candidate  SSS. 

Flexibility,  survivability,  and  satellite  performance 
improvement  objectives  are  not  modeled.  This  is  because  no 


two  definitions  of  survivability  and  flexibility  are  identi¬ 
cal.  Survivability  can  mean  how  well  the  system  avoids  or 
deters  hostile  (man  made)  actions  or  its  ability  to  avoid 
asteroids  and  space  dust  or  space  particles  (natural  hostile 
actions).  Thus  for  the  level  of  detail  of  this  model,  it  is 
impossible  to  calculate  a  measure  for  survivability. 

Future,  more  detailed  iterations  should  include  this  measure 
as  a  PI.  Some  of  the  inputs  to  this  PI  would  be  subsystem 
projectile  avoidance  (kinetic  weapons),  shielding  thickness 
(meteroids,  kinetic  energy,  and  possibly  laser  weapons),  and 
number  of  units  in  each  subsystem. 

The  flexibility  objective  is  subject  to  the  same  defin¬ 
ition  and  inability  to  calculate  a  "number"  as  the  surviva¬ 
bility  objective;  therefore,  flexibility  is  not  calculated. 
Inputs  to  the  flexibility  measure  in  future  iterations  would 
probably  include  man’s  influence  on  the  system  and  the  abil¬ 
ity  of  the  system  to  perform  different  types  and  kinds  of 
missions . 

A  measure  of  satellite  performance  improvement  requires 
specific  descriptions  of  the  satellites  serviced.  As  dis¬ 
cussed  earlier,  these  descriptions  are  not  available;  there¬ 
fore,  the  satellite  performance  objective  is  not  modeled. 
Future  iterations  should  include  this  measure.  The  vari¬ 
ables  "average  mass  delivered  to  a  satellite”  (X5bl)  and  the 
time  interval  between  services  ’’Satellite  service  interval’’ 
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(U6)  should  be  important  inputs  to  this  PI 
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Table  4.11 


Performance 

1 ndicies 

Z1 

Operat i 

ng  Cost 

Hour 

ly  Cost  of 

Operai 

Ling  a  SSS 

Z2 

Initial 

Cost 

R&D  . 

Product  ion 

,  and 

Deployment 

Z3 

Rel iabi 

1  i  ty 

Abi  1 

ity  to  Perf 

orm  a 

Mission 

Z4 

Mass  De 

1  i  vered 

Mass 

Oe 1 i vered 

Per  T i 

tme 

The  four  Pi's  modeled  are  shown  in  Table  4.11.  The 
operating  and  initial  costs  are  modeled  for  comparative  pur¬ 
poses  only  and  are  not  the  total  costs.  Costs  not  included 
are  assumed  to  be  equal  regardless  of  the  number  or  types  of 
subsystems.  Costs  regarded  as  equal  would  not  add  any  mean¬ 
ingful  information  to  the  decision  process;  therefore,  noth¬ 
ing  would  be  gained  by  their  calculation.  If  a  specific 
cost  was  determined  to  not  be  equal  for  all  systems,  the  new 
cost  would  have  to  be  added  to  future  iterations  of  this 
mode  I  . 

Operating  Cost: 

Operating  costs  represent  the  costs  of  operating  a  SSS 
per  hour.  The  costs  are  calculated  assuming  the  SSS  is 
fully  operational  and  deployed.  Table  4.12  shows  the  opera¬ 


tional  costs  considered. 


3 


Table  4 . 12 


Operating  Cost  Matrix 


SSS  Subsystem 


Operating  Costs  Modeled 


f  ue  1 


manpower 


parts 


launch  site 


other 


note:  x  indicates  cost  included 

s  indicates  the  cost  assumed  the  same  all  models 
n  indicates  cost  not  applicable  to  subsystem 


The  costs  which  are  designated  with  an  "s"  are  costs 
which  are  approximately  equal  in  each  model.  Examples  of 
costs  not  considered  are  training,  overhead  personnel, 
technical  system  management,  prelaunch  checkouts,  launch 
vehicle  recovery  and  transportation,  and  cost  of  the  mass 
delivered  to  the  satellites.  Costs  designated  by  ”n”  are 
not  applicable  to  the  particular  subsystem.  The  operating 
costs  calculated  are  designated  by  ”x"  and  are  calculated  in 
dollars  per  hour.  Figure  4.12  identifies  the  subsystem 
state  variables  used  to  calculate  the  different  operating 
costs . 
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I - LG 


X335 ,  X320.  X32b.  X301 


Ups 


Cost 


- QSV - X500. 


—  FHG - X100. 


X555 .  X52b,  X501 


X 1 20 ,  X110.  XI 35 


1 — SB - 

— X400 ,  X415,  X425 

X301=LG  Mission  Rate 

X320=H  LG  Launch 

Sites 

X32b=Mass  LG  Fuel 

X335=Launch  Site 

1 nterva 1 

:  X500=#  OSV 

X501=0SV  Mission 

Rate 

!  X52b=Mass  OSV  Fuel 

X555=0SV  Crew 

X400=#  SBs 

X415=SB  Crew 

i  X425=Mass  of  SB 

X100=FHG  Mission 

Rate 

X110=FHG  Payload 

X120=8  FHG  Launch 

Sites 

X135=FHG  Launch  Site 

I  nterva 1 

Figure  4.12  State  Variables  In  Operating  Costs 


A  brief  description  of  the  equations  used  to  calculate 
the  operating  costs  follows.  For  detailed  cost  equation 
derivation  and  the  factors  included  in  the  cost  calculations 
see  Appendix  E. 


Launch  site  operating  costs  are  based  on  the  required 
launch  rate  from  each  site  and  the  number  of  launchers  (or 
launch  sites).  The  FHG  launch  site  operating  cost  includes 
an  additional  cost  for  ground  based  energy  requirements. 

LG,  OSV ,  and  SB  operating  costs  include  a  cost  for 
fuel.  Fuel  costs  are  derived  from  the  amount  of  fuel 
required  per  mission  and  the  frequency  of  missions.  in 
addition,  the  SB  and  FHG  have  a  cost  for  parts  and  expend¬ 
ables. 


OSV  and  SB  personnel  costs  are  based  on  the  number  of 
crew  members  . 
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initial  Costs  . 


Initial  costs  are  the  costs  incurred  prior  to  the  ser¬ 
vicing  system  becoming  operationally  ready.  initial  costs 
calculated  are  SSS  Research  and  Development  (R&D), 
purchase/fabrication,  and  deployment.  Table  4.13  displays 
initial  costs  calculated  for  each  subsystem. 

Table  4.13 
Initial  Cost  Matrix 


In  most  cost  studies  initial  costs  are  amortized  over 
the  life  of  the  system  and  then  figured  into  the  operating 
costs.  This  amortization  is  not  done  in  this  study  because 
the  1 ife  of  any  SSS  cannot  be  predicted  with  any  degree  of 
certainty.  However,  a  lump  sum  initial  cost  is  still  a  good 
comparative  measure  of  any  SSS  impact  on  the  federal  budget. 
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For  this  reason,  decision  makers  interviewed  felt  the 


seperation  of  initial  and  operational  costs  was  important 
and  useful.  Figure  4.13  displays  the  subsystem  state  vari 
ables  used  in  the  different  calculations. 


X300=«  LGs 
X345=LG  Reliability 
<X500=«  OSV 
iX545=0SV  Reliability 
XI 10=FHG  Payload 
X400=ff  of  SBs 
X425=Mass  of  SB 


X325 

.  X345 

X555 

.  X545. 

X525 

X110, 

X3b0 

X415  , 

X425 

X300 , 

X325. 

X345 

X500 , 

X545, 

X525,  X555 

X120, 

X110. 

X360 

X400  , 

X425 

same 

a  1 1  mode  1 s 

same 

a  1 1  mode  1 s 

none 

X425 

X325=Mass  of  LG 
X360=Rendezvous  Alt 
X525=Mass  of  OSV 
X555=0SV  Crew 
X120=»  FHG  Launch  Sites 
X415=SB  Crew 


Figure  4.13  State  Variables  in  initial  Costs 


The  R&D  costs  are  based  on  subsystem  structure  mass, 
subsystem  reliability,  current  state  of  technology,  and  R&D 
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team  experience.  The  OSV  and  LG  R&D  costs  increase  as  their 
reliability  increases.  In  addition,  the  OSV  cost  decreases 
as  the  OSV  manned  intervention  increases  and  robotic  influ¬ 
ence  decreases  (ie  more  robotic  implies  more  R&D  cost). 

Since  life  support  equipment  is  on  all  manned  space  vehicles 
already  there  should  be  very  little  need  for  life  support 
equipment  R&D;  however,  considerable  R&D  will  be  required  to 
produce  a  robotic  OSV. 

Production  costs  take  into  consideration  subsystem 
structure  mass  and  the  number  of  units  of  each  subsystem 
produced.  The  unit  production  costs  include  a  cumulative 
learning  curve  adjustment.  This  adjustment  accounts  for 
decreasd  cost  per  unit  as  the  number  of  units  produced 
increases.  The  OSV  and  LG  costs  are  designed  to  increase  as 
subsystem  reliability  increases.  The  OSV  costs  increase  as 
the  OSV  manned  intervention  increases  and  robotic  influence 
decreases.  An  assumption  is  made  that  as  the  OSV  is 
designed  to  be  more  robotic,  the  R&D  cost  increases  and  pro¬ 
duction  cost  decreases.  It  is  assumed  that  life  support 
equipment  requires  high  reliability  and  prcision  to  produce, 
while  robotic  equipment  will  be  more 

The  SB  is  the  only  subsystem  with  a  deployment  cost. 
This  cost  is  based  on  the  SB  mass  to  be  delivered  to  orbit 
and  the  number  of  SBs . 


Satellite  Servicing  System  Reliability. 

The  SSS  reliability  is  a  measure  of  each  SSS '  s  ability 
to  perform  a  specific  mission.  Here,  the  specific  mission 
is  defined  as  the  system's  ability  to  complete  one  servicing 
mission.  In  other  words,  the  probability  that  the  OSV  is 
operational  and  can  obtain  needed  supplies  (from  SB  or  LG) 
to  service  a  satellite.  Table  4.14  shows  the  subsystems 
included  in  the  reliability  measure  calculation. 

Table  4 . 14 
Reliability  Matrix 


Model 

!  Subsystems 

Included  in  Calculation 

:  OSV 

1 

• 

lg  : 

FHG 

SB 

LG+OSV 

1  X 

1 

1 

x  ! 

n 

n 

FHG+LG+OSV 

!  x 

1 

• 

x  i 

n 

n 

SB + FHG+LG+OSV 

;  x 

• 

< 

n  : 

n 

n 

note:  x  indicates  applicable  to  calculation 

n  indicates  not  applicable  to  calculation 


Important  simplifying  assumptions  are  made  in  the  FHG+LG+OSV 
and  the  SB+FHG+LG+OSV  models.  The  FHG+LG+OSV  model  does  not 
include  the  FHG  reliability  because  an  assumption  was  made 
that  the  LG  is  capable  of  carrying  enough  mass  to  resupply 
the  OSV  for  one  mission.  Therefore,  the  FHG  has  no  effect 
on  the  systems  ability  to  perform  the  specific  mission 
defined  above.  The  SB+FHG+LG+OSV  model  has  a  built-in 
assumption  that  the  SB  would  store  a  specified  safety  level 


of  mass.  Consequently,  the  reliability  calculation  assumes 
the  OSV  could  continue  to  service  satellites  by  using  this 


Figure  4.14  State  Variables  in  Reliability 

(lass  Delivered  to  the  Satellites. 

As  a  measure  of  mission  accomplishment  this  PI 
represents  the  total  amount  of  mass  delivered  to  the  satel¬ 
lites  per  time  (kg/hr).  The  mass  consists  of  expendables 
and  replacement  parts  for  the  satellites.  This  Pi  is  calcu 
lated  using  the  state  variables  ”OSV  missions  per  time” 
(X501)  and  ”OSV  payload  per  mission"  (X510). 


4. 3. 2. 4  Physical  Model  Description.  In  this  study  the 
term  physical  model  refers  to  the  state  and  constraint 
(equality  and  inequality)  equations  within  the  model.  The 
physical  model  is  not  some  type  of  scale  model  or  some  type 
of  hardware  model.  The  purpose  of  the  physical  model  is  to 
identify  and  explain  the  important  relationships  that  exist 
within  a  specific  subsystem  (intra-subsystem  relations)  and 
the  relations  that  exist  between  the  different  subsystems 
(inter-subsystem  relations)  for  each  potential  SSS .  Figure 
4.15  is  a  schematic  of  these  relations.  It  is  designed  as 
an  aid  to  understand  the  discussion  in  the  following  sec¬ 
tions  (4. 3. 2. 4.1  and  4. 3. 2. 4. 2).  The  first  column  in  Figure 
4.15  is  a  complete  listing  of  all  the  state  variables  (see 
Table  4.9  or  Appendix  F).  The  state  variables  are  grouped 
according  to  whether  they  describe  a  specific  subsystem’s 
characteristics  (physical  descriptions)  or  describe  how  the 
subsystem  is  used  (subsystem  usage). 


ical  Model  Schematic 


The  second  column  has  four  large  blocks  representing 
the  four  subsystems  used  in  some  or  all  of  the  potential 
SSS .  The  smaller  blocks  inside  each  larger  subsystem  block 
represent  an  equation  or  group  of  equations  relating  the 
different  subsystem  state  variables  to  each  other.  The 
titles  of  the  smaller  blocks  represent  the  type(s)  of  equa¬ 
tions  grouped  in  the  box.  The  ”D.nn”  renresents  the  equa¬ 
tions  located  in  Appendix  D  associated  with  the  box  title. 
The  arrows  represent  the  existance  of  shared  state  variables 
between  any  two  boxes.  The  state  variable  symbols  printed 
beside  each  arrow  represent  which  variables  are  shared.  For 
clarity  the  exogenous  variables  are  not  shown  in  this 
schematic  because  these  "variables”  are  in  fact  constants. 
Figure  4.15  is  designed  to  graphically  show  how  the  states 
of  each  subsystem  interact  and  influence  the  states  of  the 
other  subsystems.  It  is  these  states  that  will  be  varied  to 
generate  optimal  SSS  realizations. 

The  third,  fourth,  and  fifth  columns  represent  the 
inter-subsystem  relations  that  exist  for  each  of  t'  poten¬ 
tial  SSS.  The  LG+OSV  system,  which  is  in  column  three,  is 
the  simplest  and  most  basic  SSS.  Therefore,  the  addition  of 
the  FHG  and  SB  subsystems,  which  are  shown  in  column  four 
and  five  respectively,  result  in  modifications  to  the  basic 
SSS.  In  addition  to  the  above  defined  use  of  arrows,  those 
arrows  going  from  a  column  three  box  to  a  column  four  or 
five  box  represent  the  same  basic  equation  with  modifica- 
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tions  to  account  for  the  additional  subsystems.  Again  the 


D.nn  represent  the  equation  numbers  from  Appendix  D.  The 
next  two  sections  present  qualitative  descriptions  of  the 
equations  represented  in  each  of  the  boxes. 

4. 3. 2. 4.1  Intra-Subsystem  Relationships.  Prior  to  the  dis¬ 
cussion  of  each  of  the  individual  subsystem  internal  rela¬ 
tionships.  a  few  assumptions  and  general  relationships  com¬ 
mon  to  all  the  subsystems  will  be  discussed. 

General  Assumptions  and  Relations 

1.  All  subsystems  must  be  able  to  hold  adequate  fuel,  life 
support,  and  parts  to  function  from  one  resupply  time 
until  the  next.  For  example,  the  OSV  must  carry  enough 
fuel  to  provide  the  thrust  to  complete  a  servicing  mis¬ 
sion  ( Eqs  (D.15),  ( D . 17 ) ,  and  (D.22>>. 

2.  The  OSV,  LG,  and  FHG  have  limitations  on  their  vehicle 
structure  mass  ratios  to  prevent  carrying  more  mass 
than  the  structure  can  support  (Eqs  (D.10),  (D.ll), 
(D.18),  and  (D.19)).  The  FHG  has  an  assumed  structure 
mass  ratio  of  0.1  which  is  embedded  in  intermediate 
variable  equation!ll3  (Appendix  F,  1113).  The  SB  has 
the  mass  stored  to  structure  mass  ratio  set  equal  to  a 
constant  ( Eq  (D.42)). 

3.  Relations  exist  between  a  subsystem  mission  rate,  the 
number  of  launch  sites,  and  the  number  of  units  of  each 
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sion  lengths,  vehicle  ref urbi shment  time  between  mis¬ 
sions,  and  launch  site  refurbishment  time  between 
launches  from  the  same  site  (Eqs  (D.6),  (D.7).  (D.8), 

( D . 9 ) .  (D.17).  (D.24).  (D.30),  (D.34).  (D.36).  (D.44>) 


4.  All  mass  used  by  satellites  and  service  vehicles  must 
be  launched  from  Earth.  There  is  no  consideration 
given  for  moon  or  asteroid  originated  mass. 


Service  vehicle  mission  lengths  and  the  time  between  LG 
launches  must  have  an  upper  bound  to  accomodate  the 
maximum  time  people  can  be  in  space  before  returning  to 
Earth.  Exposure  to  radiation,  psychological  health, 
and  quality  of  job  performance  are  reasons  for  limiting 
the  time  people  stay  in  space.  This  assumption 
requires  an  LG  be  launched  as  least  as  often  as  the 
maximum  time  people  can  remain  in  space  (Eqs  (D.5).  (D.16)) 


Service  vehicles  and  launch  vehicles  must  be  able  to 
rendezvous  and  transfer  mass  ( peop l e , parts , f ue l s > .  The 
different  rendezvous  altitudes  and  time  required  to 
transfer  mass  from  one  vehicle  to  another,  or  from  a 
service  vehicle  to  a  satellite,  affect  the  amount  of 
fuel  the  vehicle  must  carry  and  the  vehicle  mission 
1 ength . 


By  definition  the  reliability  of  any  subsystem  lies 
between  zero  and  one.  Therefore,  the  OSV  and  LG  sub¬ 
systems  reliability  must  be  upper  and  lower  bounded 
(Eqs  (  D  .  1  3 )  ,  (  D  .  1  4  )  ,  (D.20).  <l).2l>). 
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The  time  an  orbital  vehicle  can  remain  in  a  stable 
orbit  above  the  Earth  is  dependent  on  its  altitude. 
Therefore,  the  minimum  orbit  altitude  '’Minimum  orbit 
Altitude”  (U58)  for  the  SB  and  the  rendezvous  orbit 
altitude  for  other  vehicles  (OSV.FHG.LG)  must  be  input 
to  the  model  (Eq  ( D . 27 ) ) .  For  the  LG+OSV  SSS  model  the 
minimal  orbital  altitude  was  set  at  185km.  This 
minimum  altitude  allows  for  a  vehicle’s  orbit  to  remain 
stable  (ie.  not  experience  significant  orbital  degrada¬ 
tion  from  atmospheric  effects)  for  3  days  (Bate,  1971: 
152;  Dept,  of  AF ,  1985:3-13).  For  the  other  two  SSS 
models  the  exogenous  input  should  be  set  to  a  larger 
value  depending  on  the  required  length  of  time  a  vehi¬ 
cle  is  expected  to  remain  in  orbit.  Table  4.15  pro¬ 
vides  a  list  of  altitudes  and  the  length  of  time  an 
orbit  is  expected  to  remain  stable. 

Table  4.15 

Spacecraft  Altitude  vs 
Time  in  Orbit  (Dept,  of  AF .  1985:3-13) 


Nautical  miles 


Ki 1 ometers 


Days 


yin 

EM 


157.4 

0.5 

185.2 

3 

277.8 

35 

370.4 

200 

555.6 

4000 

OSV  Subsystem. 


The  OSV  is  required  to  make  orbit  position  and  altitude 
transfers.  A  multitude  of  orbital  transfer  methods  exist; 
however,  our  model  will  use  Hohmann  orbit  transfers  which 
minimize  delta  velocity  requirements  which  in  turn  minimize 
fuel  mass  requirements  (Eq  (D.22)).  The  OSV  is  assumed  to 
be  propelled  by  a  chemical  system  with  fuel  specific  impulse 
fixed  at  an  expected  technological  upper  limit  of  500  sec 
”0SV  ISP"  (U24).  The  delta  velocity  equations  and  fuel  con¬ 
sumption  equations  are  explained  in  Appendix  G. 

Equations  D.23,  D.25,  and  D.26  relate  the  OSV  payload 
and  number  of  satellites  serviced  per  mission  by  the  OSV  to 
the  amount  of  mass  the  satellites  receive  and  the  number  of 
satellites  needing  servicing. 

LG  Subsystem. 

The  LG  launch  system  has  one  or  more  stages  (Eq  (D.12)) 
and  a  set  value  of  400  sec  for  fuel  specific  impulse  (Isp) 
”MLG  ISP”  (U33).  The  equations  for  LG  required  delta  velo¬ 
city  to  orbit  are  derived  using  approximate  values  for  drag, 
gravity.  Earth’s  rotation,  and  trajectory  shaping  losses 
from  (Dept  of  AF ,  1965:246)  Eq  (D.15).  Although  the  LG  is 
not  identified  as  a  manned  or  unmanned  vehicle,  it  must  be 
capable  of  carrying  men  if  the  SB  or  OSV  are  manned  subsys¬ 
tems.  The  LG  will  go  into  the  rendezvous  orbit,  rendezvous 
with  enough  OSVs  or  a  single  SB,  unload  its  payload,  and 
return  to  Earth  (Eqs  (D.30)  and  (D.44)). 


FHG  Subsystem. 


The  high-G  launch  vehicle  is  assumed  to  receive  an  ini¬ 
tial  delta  velocity  from  an  Earth  based  energy  source.  The 
launch  velocity  is  equivalent  to  the  velocity  an  orbital 
vehicle  would  have  if  it  was  at  the  perogee  of  an  elliptical 
orbit.  The  appogee  of  the  launch  trajectory  is  at  the  ren¬ 
dezvous  altitude.  When  the  high~G  vehicle  leaves  the 
Earth's  surface  no  additional  thrust  is  assumed  to  be 
required  except  for  an  orbital  circularization  thrust  at 
appogee.  This  thrust  is  required  to  prevent  the  FHG  vehicle 
from  re-entering  the  atmosphere  and  being  destroyed  prior  to 
the  payload  being  off-loaded.  The  Earth  based  energy 
requirement  is  calculated  as  a  change  in  kinetic  energy  the 
FHG  vehicle  experiences.  Concerns  for  air  drag  and  inclina¬ 
tion  changes  have  not  been  modeled;  however,  the  total 
amount  of  energy  needed  is  assumed  to  be  twice  the  energy 
required  from  the  change  in  kinetic  energy  calculation. 
Intermediate  variable  equations  calculate  the  above  rela¬ 
tions  and  are  inputs  for  the  FHG  cost  equations  (see  Appen¬ 
dix  F,  1100  to  1120).  Eq  (D.35)  prevents  the  optimization 
computer  program  PROCES  from  trying  to  reduce  the  FHG  pay- 
load  to  ridiculously  small  amounts,  but  launched  very  often. 
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SB  Subsystem. 

The  SB  is  modeled  as  a  warehouse  and  OSV  refurbishment 
facility.  The  ratio  of  SB  structural  mass  to  SB  mass 
storage  capacity  is  set  equal  to  a  constant  value  of  1.0  "SB 
structure  mass  to  storage  mass  ratio"  (1)133)  Eq  (D.42).  The 
SB  is  assumed  to  store  all  types  of  mass  that  is  required  in 
space  with  a  predetermined  safety  level  "SB  safty  level” 
(U130)  of  one  month.  All  payload  aboard  the  LG  launch  sys¬ 
tem  must  be  off-loaded  to  the  SB  (D.40).  Payload  aboard  the 
FHG  may  be  off-loaded  directly  to  the  servicing  vehicles  or 
to  the  SB.  Since  the  FHG  is  assumed  to  be  expendable,  the 
FHG  vehicle  could  act  as  a  temporary  on-orbit  storage  facil¬ 
ity.  Thus  if  the  LG  transports  fuel,  it  must  off-load  the 
fuel  to  the  SB  where  it  will  be  stored.  If  the  FHG  carries 
fuel,  the  SB  need  not  store  it.  No  attempt  is  made  to  model 
the  time  and  fuel  requirements  for  the  OSV  or  LG  to  rendez¬ 
vous  with  the  FHG  and  off-load  the  FHG  payload  or  tow  the 
FHG  to  the  SB.  In  the  models  without  an  SB,  the  FHG  just 
has  to  get  into  orbit  because  an  assumption  is  made  that  the 
OSV  and  LG  could  rendezvous  at  the  FHG  vehicle  location  in 
orbit.  The  OSV  and  LG  must  go  to  the  SB  each  mission;  how¬ 
ever.  the  FHG  is  not  required  to  rendezvous  with  the  SB. 
Therefore,  possible  alternatives  include  the  FHG  circulari¬ 
zation  thrust  placing  the  FHG  in  a  position  to  rendezvous 
with  the  SB  or  the  OSV  rendezvous  with  the  FHG  just  before 
or  just  after  rendezvousing  with  the  SB. 
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4 . 3 . 2 . 4 . 2  Inter-Subsystem  Relationships.  The  inter¬ 
subsystem  relationships  describe  the  relationships  between 
the  different  subsystems.  These  relationship  equations  are 
presented  as  boxes  in  columns  three  through  five  in  Figure 
4.15.  Column  three  is  for  the  LG+OSV  SSS ,  column  four  for 
the  FHG+LG+OSV,  and  column  five  for  the  SB+FHG+LG+OSV  SSS. 
Therefore,  the  simplest  LG+OSV  inter-subsystem  equations  are 
presented  first  followed  by  the  more  complex  FHG+LG+OSV  and 
SB+FHG+LG+OSV  interrelations. 


LG+OSV  Inter-Subsystem  Relations. 


Since  the  LG  is  the  only  launch  system,  the  total  mass 
required  in  space  (satellite  and  OSV  needs)  must  be  carried 
into  orbit  by  the  LG  fleet  ( Eq  (D.28)), 


The  OSV  fleet  must  be  able  to  hold  a  complete  LG  pay- 
load  to  avoid  the  LG  acting  as  a  storage  facility  and 
remaining  in  orbit  for  long  periods  of  time.  Simply  put. 
when  the  LG  goes  into  orbit  enough  OSVs  must  be  at  the  ren¬ 
dezvous  location  to  hold  the  entire  LG  payload  so  the  LG  can 
immediately  return  back  to  earth  to  begin  another  mission 
(Eq  ( D . 29 ) ) . 


FHG+LG+OSV  Inter-Subsystem  Relations. 


The  addition  of  the  FHG  to  the  LG+OSV  model  (Fgure 
4.15,  FHG+LG+OSV  Column  four)  requires  the  revision  of  one 
inter-subsystem  equation,  the  creation  of  a  new  inter¬ 


subsystem  equation,  and  the  addition  of  FHG  cost  equations. 


The  previous  requirement  that  the  LG  carry  ail  mass  to 


orbit  is  replaced  with  the  total  mass  carried  by  the  LG  and 
FHG  equal  to  the  total  mass  required  in  space  (ie.  mass 
required  by  spacebased  subsystems  (OSV)  and  the  mass 
delivered  to  the  satellites  (Eq  ( D . 37 ) ) ) . 

Since  the  FHG  is  capable  of  only  launching  mass  that 
can  withstand  a  high-G  launch,  the  mass  needed  in  space 
(fuels,  parts,  life  support,  and  people)  must  be  split  into 
two  groups:  mass  that  can  withstand  a  high-G  launch  (fuels 
and  some  parts)  and  mass  that  must  be  low-G  launched  (peo¬ 
ple,  life  support,  parts).  An  assumption  is  made  that  all 
life  support  mass  would  be  low-G  launched.  Eq  (D.33) 
represents  the  requirement  that  the  total  payload  mass 
launched  by  low-G  launch  systems  must  be  greater  than  or 
equal  to  the  mass  requiring  low-G  launch. 

SB  +  FHG  +  LG-*-OSV  Inter-Subsystem  Relations. 

The  addition  of  the  SB  to  the  FHG+LG+OSV  model  causes 
three  inter-subsystem  equations  to  change,  one  LG  intra¬ 
subsystem  equation  change,  the  addition  of  the  SB  cost  equa¬ 
tions,  and  a  change  to  the  reliability  PI  equation. 

The  requirement  for  the  OSV  fleet  to  hold  a  single  LG 
payload  is  replaced  with  a  requirment  for  a  single  SB  to 
hold  an  entire  LG  payload  (Eq  (D.40)).  The  relation  between 
the  total  mass  the  LG  and  FHG  must  carry  to  space  is 
increased  to  include  the  SB  required  mass  ( Eq  (0.43)).  The 


minimum  amount  of  mass  the  LG  must  carry  is  increased  to 
include  the  SB  low-G  launched  mass  requirements  (Eq  (D.41)). 
Since  the  LG  is  now  transfering  mass  to  the  SB  instead  of  to 
an  OSV ,  a  LG  to  SB  mass  transfer  rate  is  used  instead  of  an 
G  to  OSV  transfer  rate  (Eq  (0.44)). 

4 . 4  Chapter  Summary 

This  chapter  has  presented  the  model  development  from 
the  initial  conceptualization  phase  through  the  development 
of  analytical  models.  The  three  models  have  identified 
important  relationships  existing  between  the  different  sub¬ 
systems  and  a  set  of  criteria  for  comparing  potential  sei — 
vicing  systems.  The  models  should  be  an  excellent  starting 
point  for  future  more  detailed  SSS  models.  Future  models 
should  examine  the  accuracy  of  the  assumptions  made  in  this 
study  and  provide  more  detailed  analysis  where  necessary. 

The  next  chapter  will  provide  an  analysis  and  optimization 
of  the  LG+OSV  model.  Availability  of  resources  (computer 
and  manpower)  precluded  the  analysis  of  the  other  two 
mode  1 s  . 
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V.  System  Analysis 


o . L  1 ntroduct ion 


This  chapter  describes  and  demonstrates  the  analysis 
step  of  the  systems  engineering  (SE)  methodology  as  intro¬ 
duced  in  chapter  II.  The  purpose  of  this  step  is  twofold: 
(1)  to  generate  a  solution  set  based  on  engineering  require 
ments ,  and  (2)  to  describe  how  good,  in  an  engineering 
sense,  that  solution  is.  These  two  tasks  will  be  referred 
to  as  ”non-dominated  solution  set  (NDSS)  generation,  and 
solution  validation.”  Figure  5.1  depicts  the  information 
flow  between  the  two  tasks  of  the  analysis  step  as  it 


relates  to  the  other  parts  of  the  SE  methodology. 


for  validity.  This  process  is  continued  until  the  NDSS  is 
validated.  The  final  N D33  generated  must  be  of  sufficient 
detail  to  allow  implementation.  As  described  in  Chapter  II. 
this  marks  the  conclusion  of  Phase  I  of  the  SE  approach. 

The  valided  NDSS  is  then  the  input  to  the  value  system 
application  (decision  making)  process  of  Phase  II. 

The  method  of  generating  the  NDSS  depends  on  the  type, 
form  and  detail  of  the  model.  In  the  initial  stages  of  the 
project  the  mode  Is  may  be  as  simple  as  the  word  equations 
presented  in  section  4.2.  The  NDSS  could  be  generated  by  a 
technique  using  pairwise  comparison  of  the  performance  indi- 
cies  (Pi’s).  As  the  model  becomes  more  complex  (like  the 
analytical  models  in  chapter  IV)  different  techniques,  such 
as  vector  optimization,  are  applied.  Except  for  simple 
problems,  vector  optimization  solution  generation  techniques 
must  be  mechanized  on  a  digital  computer.  The  computer  pro¬ 
gram  PROCES  (DeWispelare  and  Clark. 1983)  was  used  to  gen¬ 
erate  the  NDSS  for  this  study. 

Validation  is  the  process  of  ensuring  that  the  abstract 
representation  (model)  of  the  physical  system  behaves  like 
the  real  system.  The  degree  to  which  the  model  behavior 
matches  the  real  system  depends  on  the  structure  and  detail 
of  the  model.  Since  the  model  is  only  an  abstraction,  the 
results  obtained  from  it  are  only  useful  to  within  certain 
limits.  These  limits  depend  on  the  areas  of  real  system 


behavior  that  are  of  interest  and  the  assumptions  that  are 


used  during  construction  of  the  model.  The  focus  of  the 
validation  task  also  varies  as  the  project  develops.  Ini¬ 
tially.  the  only  concern  may  be  realizability  of  the  solu¬ 
tions.  In  the  more  advanced  stages  of  a  project  other  fac¬ 
tors,  such  as  the  sensitivity  of  the  results  to  model  param¬ 
eter  changes,  become  more  important. 

The  remainder  of  this  chapter  will  present  the  analysis 
results  for  the  model  of  a  low-G  launch  vehicle  and  Orbital 
Servicing  Vehicle  system  (LG^OSV).  The  other  system  models 
described  in  Chapter  IV  can  be  analyzed  using  the  same  tech¬ 
niques;  however,  resource  constraints  prevented  their  inclu¬ 
sion  in  this  effort.  The  validity  of  the  model  and  NDSS  is 
addressed  (in  section  5.3)  in  terms  of  realizability, 
optimality  and  sensitivity..  A  presentation  of  the  concepts 
necessary  to  understand  the  analysis  results  is  given  prior 
to  the  discussion  of  the  results. 


b . z  Concepts 


The  following  presentation  of  concepts  (terms,  theory, 
tools,  and  techniques),  used  for  the  LG+OSV  model  analysis 
is  presented  in  two  parts.  The  first  part  describes  impor¬ 
tant  concepts  used  for  the  NDSS  generation  task,  while  the 


space  model  are  conflicting;  specifically,  minimize  initial 
and  operating  costs  while  maximizing  mass  delivered  to  orbit 
and  reliability.  A  traditional  approach  to  solving  such  a 
problem  is  to  optimize  the  system  with  respect  to  one  objec¬ 
tive.  while  fixing  the  remaining  objectives  at  acceptable 
levels.  Typically,  this  approach  will  require  further 
suboptimization  and  rarely  provides  a  decision  maker  enough 
information  to  make  the  best  possible  choice  in  as  short  a 
time  as  possible.  A  desirable  alternative  to  the  tradi¬ 
tional  approach  is  vector  optimization.  Vector  optimization 
generates  a  set  of  solutions  (called  an  NDSS)  and  a  means 
for  analyzing  the  tradeoffs  between  the  performance  indices. 

The  following  paragraphs  describe  the  vector  optimiza¬ 
tion  concepts.  The  results  of  vector  optimization  have  dis¬ 
tinct  meaning  when  borh  the  model  and  PI  equations  of  the 
statespace  model  are  convex.  However,  for  this  study,  these 
equations  (functions)  are  not  convex.  Therefore,  a  discus¬ 
sion  of  what  impact  convexity  has  on  determining  the  NDSS 
will  be  presented.  Then  a  discussion  of  how  to  solve  a  vec¬ 
tor  optimization  problem  (VOP)  by  casting  it  into  the  form 
of  an  iterative  scalar  optimization  problem.  The  scalar 
optimization  methods  chosen  for  use  in  solving  the  VOP  are 
then  described.  The  section  concludes  with  a  discussion  of 
how  the  concepts  presented  are  implemented  for  the  non- 
convex  model  of  this  study. 


where  Z(X)  is  a  p  dimensional  vector  of  Pi’s,  X  is  an  n- 
dimensional  vector  of  state  variables.  The  G.’s  are  the 
constraints  which  define  the  feasible  region  of  the  X 
(state)  space.  The  concept  oT  Pareto  optimality  or  non¬ 
dominance  is  used  to  identify  the  efficient  set  of  realiza¬ 
tions  characterized  by  the  state  variable  values. 


A  specific  solution  is  a  non-dom i nated  solution  (or 
Pareto  optimal  solution)  if  its  vector  of  Pi’s  is  not  dom¬ 
inated  by  another  realization’s  vector  of  Pi’s.  for  solu¬ 
tion  A  to  dominate  solution  B  (for  a  maximization  case)  at 
least  one  PI  of  solution  A  must  be  strictly  greater  than  the 
same  PI  of  solution  B  while  the  remaining  objectives  in 
solution  A  are  greater  than  or  equal  to  the  corresponding 
objectives  in  solution  B.  Consider  the  following  example: 
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Z  =  <1 .2.3}  Z  =  <1 . 1 .3}  (5.2) 

where  za  and  ZD  are  the  vectors  of  Pi’s  for  solutions  A  and 
B  respectively.  Since  the  second  component  of  Za  is  greater 
than  the  corresponding  component  in  Z*3  and  the  remaining 
components  are  equal,  the  vector  Za  dominates  the  vector  Z^ ; 
or  equivalently,  solution  A  dominates  solution  B. 

The  process  of  generating  a  NDSS  includes  the  optimiza¬ 
tion  of  the  vector  of  Pi's  combined  with  a  check  for  domi¬ 
nance  to  identify  the  members  of  the  NDSS.  In  practice, 
when  the  objectives  are  conflicting  no  single  solution  com¬ 
pletely  dominates  all  the  others.  The  NDSS  can  be  thought 
of  as  forming  an  "efficient  frontier”  in  the  p  dimensional 
PI  space  (defined  by  Zj  .  .  .  .'Lj  .  This  frontier 

represents  the  best  that  the  system  being  optimized  can  do 
with  respect  to  the  vector  of  p  performance  indicies.  Put  a 
different  way.  for  solutions  on  this  frontier,  no  PI  can  be 
improved  without  degrading  another  PI. 

As  an  illustrative  example  of  non-dominance  consider 
the  following  two  dimension  case  (p=2)  of  three  solution 
vectors  out  of  a  set  of  N  vectors  (found  by  using  an  optimi¬ 


zation  algorithm): 


Z  (X)  =  l 

Zj(X  ) 

=  2. 

Z2(X  ) 

=  2  ] 

(5.3) 

2 

Z  (X)  =  l 

2  2 
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2  2 
z2(x  ) 

=  3  ] 
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3 

Z  (X)  =  [ 

3  3 

Zj(X  ) 

=  3, 

3  3 

Z2(X  ) 

=  2  ] 

(5.5) 

Pictorial ly ,  ZA(X)  and  Z  (X)  can  be  thought  of  as  points  on 
the  "efficient  frontier”  as  illustrated  in  Figure  5.2. 


As  can  be  seen  Z^(X)  dominates  Z*(X),  therefore  Z*(X)  is  not 
a  member  of  the  NDSS .  Neither  Z^(X)  or  Z^(X)  dominates  the 
other.  If  none  of  the  remaining  N-3  vectors  dominate  Z  (X) 
and  Z**(X),  then  Z^(X)  and  Z“*(X)  are  members  of  the  NDSS. 

There  are  several  techniques  available  for  finding 
solutions  to  the  VOP  represented  by  Eq  (5.1).  In  this 
study,  the  weighted  norm  approach  and  the  method  of  proper 


equality  constraints  as  described  by  (Chankong  and  Hairoes. 


1983'.  Ch  4)  are  used.  These  will  be  referred  to  as  the 
weighting  and  constraint  techniques  respectively.  Both 
methods  transform  the  Z(X)  vector  of  Pi’s  into  a  psuedo- 
scalar  optimization  form  to  which  standard  scalar  optimiza¬ 
tion  methods  can  be  applied. 

The  weighting  technique  is  formulated  as  follows: 

P 

MAX  J  =  MAX  T  W  *  Zr(X) 
r  =  1  r  P 

Subject  to:  (5.6) 

G-(X)>  0:  j  =  1,2 . m 

Hj  (X)  =  0:  1  =  1.2 . q 

Xk  >  0:  k  =  1,2 . n 

where  W  is  a  scalar  weighting  coefficient  for  the  r  Pi’s, 
r 

The  procedure  is  to  repeatedly  perform  a  scalar  optimization 

on  J  for  different  values  of  the  Wp’s.  The  allowable  ranges 

over  which  the  parameters  W  are  varied  can  be  estimated 

r 

from  rough  calculations,  expert  opinion,  or  scalar  optimiza¬ 
tion  for  each  Zp(X).  Each  optimal  J  has  an  associated  Z.(  X ) 
vector  of  objective  values.  After  each  iteration  this  vec¬ 
tor  of  Pi’s  is  checked  for  membership  in  the  MOSS.  If  the 
problem  is  convex,  then  each  solution  corresponding  to  a  set 
of  weights  will  be  a  member  of  the  NDSS.  Furthermore,  if 
all  combinations  of  Wp’s  are  chosen  to  meet  Eq  (5.7).  then 
this  technique  will  completely  describe  the  \DSS . 
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This  technique  describes  the  NDSS  well,  but  is  computation¬ 
ally  burdensome.  The  constraint  technique  is  simpler  to 
solve  numerically. 


The  constraint  technique  is  formulated  as  follows  : 


MAX  Z  (X) 

Subject  To: 

G. (x)  10  i  =  1,2 

H ,  ( X )  -  0:  1  =  1.2 

Z  =  Cr  r  =  2.3 

>  0  j  =  1.2 


(5.8) 


,m 

,q 

.p  r=/a 


One  PI  is  chosen  to  be  extremized  while  the  others  are  aug¬ 
mented  to  the  problem  as  additional  proper  equality  con¬ 
straint  equations.  This  scalar  optimization  problem  is  then 
solved  iteratively  for  different  values  of  the  Cp’s.  The 
Cr’s  are  scalar  values  picked  to  correspond  to  the  expected 
range  of  the  respective  PI.  The  optimum  solution  of  each 
iteration  with  a  specific  set  of  Cp’s  is  only  a  potential 
member  of  the  NDSS.  The  potential  member  must  be  compared 
against  previously  identified  solutions  for  dominance  and 
inclusion  in  the  NDSS. 


Whether  using  the  weighting  or  constraint  technique 
three  basic  processes  need  to  be  performed  iteratively: 


s'' 


1.  Select  a  new  set  of  fixed  weights  (Wr’s;  or  constraints 
(Cr's). 

2.  Perform  optimization  of  the  scalar  objective  function. 

3.  Update  the  NDSS  by  determining  non-dominance  of  the  new 
solution  with  respect  to  the  solutions  in  the  current 
NDSS. 

The  choice  of  which  technique  to  use  depends  on  many 
factors,  the  most  important  of  which  is  the  convexity  of  the 
problem.  If  the  problem  is  convex,  the  above  three 
processes  can  be  performed  efficiently.  However,  if  the 
problem  is  non-convex,  more  effort  is  required.  To  under¬ 
stand  what  is  meant  by  these  statements,  some  explanation  of 
convexity  is  needed. 

5. 2. 1.2  Convexity .  Convexity  considerations  play  a  criti¬ 
cal  part  in  the  analysis.  The  concepts  presented  here  will 
not  be  mathmatica 1 1 y  rigorous  but  will  instead  try  to  show 
the  impact  of  convexity  on  the  vector  optimization  problem. 
Definitions  of  terms  (such  as  convex  set  and  convex  func¬ 
tion)  and  appropriate  theorems  can  be  found  in  (Fiacco  and 
McCormick.  1968:  Ch  6),  or  similar  texts  on  nonlinear  optim¬ 
ization.  Three  important  basic  concepts  from  convex  set 
theory  are: 

1.  The  intersection  of  two  convex  sets  is  a  convex  set. 

2.  The  mapping  of  a  convex  set  of  points  by  a  convex  func¬ 
tion  is  a  convex  set. 

3.  The  sum  of  convex  functions  is  a  convex  function. 
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Figure  5.3  illustrates  the  first  concept.  Each  circle 


represents  a  convex  set;  therefore,  the  intersection  of  the 


two  sets.  S  .  is  also  a  convex  set 


Figure  o.3  Convex  Sets 


Figure  o.4  illustrates  the  second  concept.  In  the  fig 


ure.  Zj  and  Z2  are  convex  functions  that  map  the  convex  set 


of  points  Sx  in  X~space.  into  a  set  of  points  Sz  in  Z-space 


Thus  S  is  a  convex  set  of  points.  While  this  example  was 
z 


for  a  two  dimensional  X  space  and  Z  space,  the  concept  can 


be  extended  to  higher  dimensional  spaces.  The  generaliza¬ 


tion  is  that  if  set  S  (a  subset  of  Euclidean  n  space)  is 


convex  and  if  Zp  p=l...r  are  convex  functions,  then  the 


resulting  set  Sz  (a  subset  of  Euclidean  p  space)  will  be 


convex  . 
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Figure  5.4  Convex  Napping 


The  third  concept  means  that  the  linear  combination  of 
convex  functions  is  also  a  convex  function.  These  three 
concepts  can  be  directly  applied  to  the  vector  optimization 
prob 1 em . 

To  understand  the  implications  convexity  has  on  the 
VOP.  the  structure  of  the  model  must  be  understood.  The 
model  is  composed  of  two  sets  of  equations:  (1)  the  perfor¬ 
mance  indicies  and  (2)  the  constraints.  The  constraints 
define  the  feasible  region  (in  X-space)  from  which  the  solu¬ 
tions  to  the  VOP  must  come.  If  the  constraint  equations 
define  a  convex  set  (region),  then  by  convexity  concept  (j) 
the  feasible  region  is  also  convex.  The  PI  equations  map 
the  set  of  points  in  the  feasible  region  into  the  objective 
vector  space.  For  instance,  in  Figure  5.4  the  set  of  points 
Sx  (defined  by  the  constraints  in  the  n-d i mens i ona 1  state 
space)  are  mapped  into  a  set  of  points  S?  (in  the  p- 
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dimensional  objective  space)  by  the  PI  equations  Z^  and  ^2 
If  6 x  is  convex  and  the  P!  equations  are  convex,  then  the 
region  Sz  defined  by  this  mapping  is  a  convex  set  by  convex¬ 
ity  concepts  (1)  and  (2).  Mow  the  weighted  and  constraint 
vector  optimization  techniques  described  above  can  be  exam¬ 
ined  in  more  detail  for  use  on  convex  and  non-convex  prob- 
1  ems  . 

The  weighted  technique  linearly  combines  the  Pi’s  (Z 
space  mapping  functions)  into  a  single  scalar  function.  Thus 
by  convexity  concept  (3)  this  function  of  Pi’s  is  convex  if 
the  PI  equations  are  convex.  The  constraint  technique  optim¬ 
izes  one  PI  and  adds  the  other  Pi’s  as  extra  equality  con¬ 
straints.  The  convex  problem,  whether  solved  by  either 
technique,  has  the  property  that  any  local  optimum  for  a 
vector  optimization  sub-problem  is  the  global  solution  to 
that  sub-problem.  The  sub-problem  is  defined  as  the  problem 
associated  with  a  particular  iteration  of  the  Wp’s  or  the 
Cp’s  as  described  in  Eqs  (5.6)  and  (5.8).  For  a  convex 
sub-problem  the  weighted  technique  will  always  produce  a 
member  of  the  MOSS  (Chankong  and  Haimes,  1968:  Ch  6).  The 
solution  to  the  convex  sub-probleit  found  by  the  constraint 
technique  however,  may  not  always  find  a  point  on  the  effi¬ 
cient  frontier  (NDSS).  This  makes  it  necessary  to  compare 
solutions  found  by  this  technique  to  other  members  of  the 
MDSS  for  non-dominance. 


If  either  the  constraint  equations  or  the  PI  equations 


is  non-convex.  then  identifying  the  members  of  the  NiDSS 
using  either  technique  becomes  more  difficult.  Figure  5.5 
illustrates  this  situation. 


Figure  5.5  Non-Convex  Mapping  of 
Constraint  Space  to  Objective  Space 


As  can  be  seen  from  Figure  5.5,  there  can  exist  regions  of 
non-convexity  in  the  objective  space.  These  non-convex 
regions  cannot  be  found  by  use  of  the  weighted  technique 
decribed  by  Eq  (5.6).  To  illustrate  this.  Figure  5.6  shows 
how  the  weighted  sum  (J)  of  the  Pi’s  describes  a  line  which 


is  tangent  to  the  efficient  frontier. 


■Local 

Optimum 

\ 

\ 

/  J=^w  z 

V 

*  r  r 

Direction  of 

Increasing  J 

\ 

\ 

a 

^Efficient  Frontier 

\  \ 

Global  Optimum 

Figure  o.b  Weighted  Efficient  Frontier  Generation 

The  point  of  intersection  is  the  non-dominated  solution  for 

a  fixed  set  of  weights.  As  the  weight  parameters  W  change. 

r 

so  does  the  slope  of  the  line.  As  the  value  of  the  weighted 
sum  (J)  of  the  Pi's  changes,  it  will  define  local  and  global 
maximums  as  shown.  The  points  on  the  efficient  frontier 
that  lie  between  a  and  b  cannot  be  located  by  any  set  of 
weights;  this  graphically  demonstrates  why  all  the  members 
of  the  \DSS  cannot  be  found  by  this  method  under  non-convex 
conditions.  As  the  value  of  J  increases  (under  maximiza¬ 
tion).  any  point  of  intersection  of  the  tangent  line  between 
points  a  and  b  will  still  allow  the  algorithim  to  increase 
the  value  of  J  along  the  efficient  frontier  without  violat¬ 
ing  any  constraints. 


o  <o  v  •/  v  v*  - "  *  -  •  * 
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The  constraint  technique.  Eq  (o.8).  performs  its  func¬ 


si 


$ 


as 


tion  by  fixing  p-1  of  the  Pi’s  and  maximizing  the  remaining 


unfixed  PI.  Figure  5.7  illustrates  this  situation  for  a  two 


dimensional  PI  problem,  where  Z.  is  set  equal  to  C_ 


Figure  o.7  Constrained  Optimization 


The  sub-problem  is  solved  for  each  value  of  the  C  ’s  where 

r 


r=l,..,5.  The  solution  (Z^)  for  the  grid  point  number  1  is 


clearly  dominated  by  any  NDSS  member  between  points  a  and  b 


and  is  thus  not  a  member  of  the  NDSS.  Note  that  unlike  the 


weighted  technique  this  technique  can  find  every  point  on 


the  efficient  frontier. 


The  strengths  and  weaknesses  of  the  two  VOP  techniques 


in  generating  an  NDSS  for  a  non-convex  problem  have  been 


shown.  Section  5. 2. 1.4  will  discuss  an  implementation  of  the 


two  techniques  which  takes  advantage  of  each  one’s  strengths 


and  efficiently  generates  a  complete  and  fully  described 
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NDSS. 


5. 2. 1.3  Scalar  Optimization  Methods.  Once  the  VGP  problem 
has  been  cast  into  either  the  weighted  or  constraint  tech¬ 
nique  forms,  the  constrained  sub-problems  must  be  optimized 
using  scalar  optimization  techniques.  This  can  be  done  by 
converting  the  constrained  optimization  problem  to  an  uncon¬ 
strained  optimization  problem  (Fiacco,  and  McCormick,  1968: 
Ch4).  This  conversion  requires  the  creation  of  a  penalty 
for  the  weighting  technique  (Eq  (5.9))  and  the  constraint 
technique  (Eq  (5.10))  (Mylander,  1971:  1). 


p  m  q  2 

Max  P(X,r)  -  I  W  Zj(X)  +  r  I  ln[G,(X)]  +  I  [Hj(X)l  /r 
i = 1  i-1  1  i = 1  1 


m  P  z 

Min  P(X.r)  =  Za(X)  +  r  I  ln(Gi(X>]  +  I  [ Z  j ( X )  ]  /r 

i=*l  i  =  l  .  i  *a 

9  2 

+  I  [H,(X)J  / r  (5.10) 

i  =  1 


where  H.(X)  are  the  equality  constraints,  Gj(X)  are  the  ine¬ 
quality  constraints  and  Z.(X)  are  the  performance  index 
equations.  The  problem  is  then  solved  as  an  unconstrained 
optimization  problem  over  the  feasible  region  of  the  state 
space  (defined  by  the  G.(X)).  This  is  done  by  picking  an 
arbitrary  positive  value  for  r.  The  unconstrained  problem 
is  then  solved.  The  resulting  solution  state  vector  X 
(associated  with  the  extreme  P  value)  is  then  used  as  a 


starting  point  to  search  for  a  new  solution  associated  with 


a  smaller  value  of  r.  This  process  is  repeated  until  the 
change  in  the  value  of  successive  penalty  function  optimal 
solutions  are  within  a  desired  range  (domain  of  attraction). 
The  final  solution  is  considered  to  be  the  optimal  solution 
for  the  original  constrained  problem. 

5. 2. 1.4  Imp  1 ementation .  When  the  objective  function  or 
the  constraints  are  non-convex ,  most  minimization  techniques 
cannot  guarantee  that  a  global  solution  has  been  found. 
Usually,  given  an  initial  feasible  X  vector  starting  value, 
the  procedure  will  only  converge  to  a  local  minimum.  Thus 
to  define  the  efficient  frontier  of  the  model  the  problem 
must  be  iteratively  solved  with  many  initial  starting  points 
for  every  value  of  either  the  or  the  Cp. 

The  following  procedure  is  recommended  for  non-convex 
problems  (Chankong  and  Haimes,  1983:  Ch  6): 

1.  generate  an  NDSS  with  the  weighting  technique,  using  Wr 
between  0  and  1  with  all  combinations  of  extreeme 
values  that  satisfy  J  Wr=l 

2.  perform  the  constraint  technique  with  initial  state 
vector  starting  values,  including  the  NDSS  from  step  1, 
and  vary  the  Cp's  over  the  range  of  the  PI  values  found 
in  step  1  . 

Step  1  generates  a  range  of  values  for  the  Pi’s,  and  gives  a 
rough  picture  of  the  effecient  frontier.  The  constraint 
technique  can  then  be  used  to  trace  out  the  remainder  of  the 
efficient  frontier. 

The  computer  program  PROCES  (Clark  and  DeWispelare. 


1985)  is  designed  to  accomplish  the  task  of  vector  optimiza 


Data  tntry 
(MAIN) 


Controlling  (lament 
(MAIN) 


Scalar  optimization 
(SUMT) 


Calculate  2 
IJCAU 


Compare  against  NDSS 
(FNSS) 


Update  NDSS 
(FNSS) 


X'  All  ^ 
iterations 
complete 


NDSS  output 
(PRINT) 


Figure  5.8  Program  PROCES  Flow  Diagram 
(Clark  and  DeWispelare.  1985) 


Subroutine  MAIN  is  the  primary  controlling  element  of 
the  program.  It  mechanizes  the  application  of  the  con- 


straint  or  weighted  technique  by  iterating  the  values  of 
either  the  C^’g  or  the  Wr's  in  Eq  (5.8)  and  (5.6).  Scalar 
optimization  is  performed  by  the  sequential  unconstrained 
minimization  technique  SUMT  (Mylander.et  al,  1971).  The 
solutions  from  the  SUMT  subroutine  are  rescaled  in  subrou¬ 
tine  JCAL.  This  step  is  a  result  of  having  scaled  the 
objectives  in  the  model  to  maximize  the  computational  effi¬ 
ciency  of  the  algorithm  SUMT.  In  the  subroutine  FNSS  the 
rescaled  solutions  are  then  compared  with  other  members  of 
the  NDSS,  dominated  solutions  are  eliminated,  and  a  new  NDSS 
is  generated.  Finally  the  NDSS  is  displayed  by  the  PRINT 
subroutine.  The  PROCES  program  was  originally  written  to 
implement  the  constraint  technique  only;  however,  minor 
modifications  will  allow  PROCES  to  perform  the  weighted 
technique . 

To  implement  the  PROCES  program  the  models  described  in 
Chapter  IV  need  to  be  converted  to  a  form  usable  by  a  digi¬ 
tal  computer.  The  converted  models  are  placed  into  a  sub¬ 
routine  called  RESTNT  in  the  form  of  PI  and  constraint  equa¬ 
tions  needed  for  scalar  vector  optimization.  The  optimizer 
subroutine,  SUMT,  determines  optimal  solutions  for  the 
scalar  sub-problem.  The  scope  of  the  optimization  problem 
was  reduced  by  scaling  the  performance  index  equations,  and 
by  reducing  the  dimension  of  the  state  variable  space.  The 
most  profound  effects  on  numerical  optimization  were  real¬ 
ized  as  a  result  of  reducing  the  number  of  state  variables. 


The  results  section  of  this  chapter  will  present  the  actual 


benefits  derived  from  these  procedures. 

5.2.2  Va 1 idat ion .  Validation  is  the  process  of  deter¬ 

mining  how  closely  the  behavior  of  a  system  model  approxi¬ 
mates  the  behavior  of  the  real  system.  The  validation  task 
has  two  purposes.  First,  to  determine  the  ranges  of  the 
state  variables,  for  which  the  model  behaves  like  the  real 
system.  This  identifies  how  well  decisions,  based  on  the 
NDSS,  can  be  expected  to  perform  in  real  life.  Second,  the 
process  of  validation  identifies  discrepencies  between  the 
model  and  the  real  life  system,  the  degree  each  inconsis¬ 
tency  contributes,  and  over  what  ranges  of  performances 
these  differences  occur.  This  information  can  be  used  to  put 
limits  on  model  use.  identify  impacts  of  model  assumptions, 
and  provide  confidence  in  the  answers  generated. 


No  general  unifying  theory  can  be  used  to  determine 
whether  or  not  a  model  is  valid  for  its  intended  use.  How¬ 
ever,  a  wide  range  of  tools  and  techniques  exist  to  check 
the  validity  of  a  model  and  its  useful  range  of  application 
(  Kobayashi,  1978:  305).  These  tools  and  techniques  must  be 
implemented  with  care.  The  analyst  must  keep  in  mind  at  all 
times  the  intended  uses  of  the  model,  and  the  problem  under 
study.  This  is  necessary  so  that  key  areas  can  be  validated 
without  wasting  excess  time  and  money  on  areas  that  are  not 
important.  The  following  checks  are  used  in  this  study: 
physical  realizability  and  sensibility,  optimality  analysis. 
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and  sensitivity  analysis. 

5.2.2. 1  Physical  Realizability  and  Sensibility  of  NDSS. 

The  rea 1 i zeab i 1 i ty  and  sensibility  checks  have  no  formal  or 
theoretical  basis.  They  are  based  on  logical  examination  of 
the  model’s  general  behavior.  if  the  model’s  outputs  seem 
logically  unreasonable,  it  must  be  determined  if  the  model 
is  wrong  and  needs  revising,  if  the  model  is  showing  real 
but  unexpected  results,  or  if  the  analytical  technique  being 
applied  is  unsuitable  for  the  model  under  consideration. 

5. 2. 2. 2  Optimality  Checks.  Optimality  checks  ensure  that 
with  the  tools  used  the  solution  is  optimal  and  valid.  For 
a  non-convex  prob 1 em, ex i st i ng  search  routines  can  find  only 
locally  optimal  solutions.  For  vector  optimization  a  method 
of  checking  for  optimality  should  also  ensure  that  the  solu¬ 
tion  is  locally  noninferior.  Direct  checks  for  non¬ 
dominance  (as  implemented  in  the  FNSS  subroutine  of  PROCES) 
ensure  that  the  members  of  the  NDSS  are  truly  nondomi nated . 
In  addition,  optimality  checks  using  Lagrange  multipliers 
provide  information  on  the  possible  tradeoffs  between  the 
performance  measures,  and  the  benefits  of  relaxing  con¬ 
straints. 

There  are  several  ways  to  approach  the  problem  of 
checking  for  optimality.  Some  are  mathematically  rigorous, 
but  only  applicable  under  a  limited  set  of  conditions.  Oth¬ 
ers  are  more  relaxed  but  applicable  over  a  wider  range  of 
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conditions.  However,  they  do  not  give  as  much  assurance 
that  the  MDSS  has  been  found.  In  this  project,  both  a 
mathematically  rigorous  approach  and  a  relaxed  approach  are 
used  to  ensure  that  the  NDSS  generated  was  truly  Pareto 
optima  1 . 

Checking  the  MOSS  against  the  Kuhn-Tucker  Conditions 
for  Noninferiority  or  KTCN  (Chankong  and  Haimes,  1983:  Ch  4. 
6)  is  the  mathematically  rigorous  approach  applied.  If  the 
objective  functions  and  the  constraints  are  all  convex,  then 
the  KTCN  provide  necessary  and  sufficient  conditions  for 
global  optimality  and  noninferiority.  Under  conditions  of 
nonconvexity,  the  meaning  of  the  KTCN  is  harder  to  inter¬ 
pret,  but  still  provides  necessary  and  sufficient  conditions 
for  local  noninf eriorty .  Since  noninferior  solutions  gen¬ 
erated  by  the  weighted  method  are  always  guaranteed  to  be 
members  of  the  NDSS,  the  KTCN  check  of  these  potential  solu¬ 
tions  become  necessary  and  sufficient  conditions  to  show 
global  non i nf er ior i ty .  Generally  the  weighted  method  cannot 
find  all  members  of  the  NDSS  for  a  nonconvex  problem.  For 
those  members  of  the  NDSS  which  can  only  be  found  by  the 
constrained  method,  the  KTCN  provides  necessary  and  suffi¬ 
cient  conditions  for  local  non i nf er i or i ty .  For  the  problem 
formulation  of  the  form  defined  in  section  5. 2. 1.1  by  Eq . 
(5.1),  the  KTCN  are  (Chankong  and  Haimes.  1983:  Ch  4): 

1.  all  Z^(X)  and  G^(X)  are  differentiable 


2. 


there  exists  Aj>  0,j=l,..p,  with  strict  inequality 
holding  for  atJTeast  one  j,  and  [j.y  0,i=l,...,m,  such 
that 

(5.11) 

G£(X*)>  0,  /iiGi(X*)  =  0  (  i  =  1 . ro); 

3.  IAj*vZ(X*)  +  I  /ij  VGj ( X* )  =  0 

where  x*  is  the  potential  member  of  the  NDSS.  The  program 

PROCES  used  to  generate  the  NDSS  provides  estimates  of  the 

Lagrange  multipliers,  (  /Jj)  for  the  constraints.  These 

estimates  can  be  used  to  test  the  above  conditions  if  there 

are  no  pure  equality  constraints.  The  can  be  determined 

«) 

by  numerically  estimating  the  gradients  and  using  least- 
squares  estimation.  These  estimates  of  can  be  used  to 

«J 

show  satisfaction  of  condition  (3)  above.  Next  they  can  be 
checked  against  condition  (2).  If  the  model  satisfies  con¬ 
dition  (1)  then  the  solution  satisfies  the  KTCN  and  is 
locally  noninferior. 

The  second  more  relaxed  method  illustrated  in  Figure 
5.9  can  be  thought  of  as  a  filter.  For  each  member  of  the 
NDSS,  the  state  variables  are  individually  changed  by  a 
small  amount,  and  several  tests  are  made  to  confirm  optimal¬ 
ity.  The  first  test  checks  to  see  if  each  of  the  perfor¬ 
mance  indices  becomes  optimal  as  a  result  of  the  change.  If 
the  performance  indices  do  become  optimal,  then  the  second 
test  checks  to  see  if  any  of  the  model  constraints  are 
violated.  If  the  model  constraints  are  violated,  the  third 
test  checks  the  size  of  the  change  in  the  PI  values.  If  the 
changes  are  smaller  than  a  specified  size,  then  it  is 
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5. 2. 2. 3  Sensitivity  Analysis.  Sensitivity  analysis  iden¬ 
tifies  the  effects  of  system  parameter  changes  on  the  nomi¬ 
nal  solution,  and  under  what  circumstances  other  solutions 
become  optijnum.  This  information  provides  a  feel  for  how 
robust  the  solution  is  to  uncertainties  within  the  model. 
These  uncertainties  arise  from  the  assumptions  used  in 
building  the  model.  They  are  found  in  the  model  equations 
and  parameter  values.  These  parameter  values  may  be  only 
estimates  of  the  system’s  true  parameter  values  or  they  may 
be  chosen  to  curve  fit  a  particular  equation  to  real  system 
behavior.  This  means  that  there  is  a  degree  of  uncertainty 
in  their  values.  The  spread  of  this  uncertainty  represents 
the  model  builder’s  confidence  in  the  assumptions  he  made. 
If  over  the  possible  ranges  of  a  parameter’s  values  the 
results  are  constant  or  nearly  so,  then  conclusions  can  be 
drawn  with  confidence  in  their  validity.  However,  if  the 
solution  radically  changes  within  the  expected  range  of  the 
parameter,  then  the  suitability  to  the  real  environment  of 
the  chosen  design  is  less  certain.  This  type  of  analysis 
provides  information  on  where  the  model  is  solid,  and  where 
it  is  suspect.  Two  avenues  are  available;  implementation 
with  cautions  indicated,  or  refinement  of  the  model  to 
reduce  the  uncertainties. 

Ideally,  sensitivity  is  performed  by  varying  the  model 
parameters,  and  all  combinations  of  these  parameters,  over 


the  expected  ranges  of  the  parameter  values.  With  problems 


other  than  the  most  trivial,  the  time  and  effort  this  takes 
is  not  worth  the  additional  information  gained.  A  common 
procedure  is  to  hold  all  parameters  but  one  at  their 
expected  values,  while  the  other  parameter  excedes  its  range 
of  uncertainty.  This  is  done  for  each  parameter  which  could 
change.  The  results  are  examined  to  see  if  the  same  basic 
answer  occurs  for  all  ranges  of  the  parameter,  or  for  what 
ranges  new  types  of  answers  appear.  How  the  results  are 
examined  depends  on  the  level  of  detail  in  the  model.  In 
the  early  stages  of  a  model  analysis,  sensitivity  can  be 
done  by  changing  the  parameters  slightly,  and  reevaluating 
the  PI  values  for  each  member  of  the  NDSS.  This  provides 
information  on  which  parameters  strongly  affect  the  PI 
values.  For  later  revisions  of  the  model  or  if  large 
changes  in  the  parameters  are  examined,  then  a  new  NDSS  must 
be  generated.  Then  the  NDSS's  must  be  compared  to  determine 
the  effect  of  the  parameter  change. 

The  sensitivity  analysis  used  has  three  parts:  NDSS 
sensitivity,  model  sensitivity,  and  model  sensitivity  to 
large  parameter  changes.  Considerations  include  identifying 
variations  in  a  preferred  member  of  the  NDSS.  due  to  changes 
in  the  states  of  the  system,  or  changes  in  the  value  of  an 


exogenous  variable. 


5 . 3  Results 


The  dimension  of  a 
ity  strongly  influences 
efficiently  generate  an 
developed  in  Chapter  IV 
system  was  reduced  to  8 
computer  time  required 
plete  form. 


model’s  state  space  and  its  convex- 
the  ability  of  current  algorithms  to 
NDSS .  The  21  state  variable  model 
to  describe  a  satellite  servicing 
variables  because  of  the  excessive 
to  evaluate  this  model  in  its  com- 


Various  techniques  were  tried  to  reduce  the  dimension 
of  the  state  space  and  allow  reasonable  solution  times. 

With  this  reduction  the  sub-problems  converged  to  5  digits 
of  accuracy  in  less  than  200  CPU  seconds  on  the  CDC  Cyber 
175.  This  allowed  sufficient  iterations  of  the  VOP  sub¬ 
problems.  following  the  implementation  outlined  in  section 
5. 2. 1.4.  to  generate  the  NDSS. 

Four  state  variables  were  eliminated  by  the  first 
method,  substitution.  Model  state  equations  (equality  equa¬ 
tions)  were  solved  for  a  state  variable,  and  then  were  sub¬ 
stituted  for  these  state  variables  wherever  they  occurred. 
This  eliminates  a  state  variable,  while  ensuring  that  the 
equality  equation  is  satisfied,  and  is  not  needed  as  an 
explicit  constraint.  Model  Eqs  (D.9).  (D.23).  (D.26).  and 


"-S'" 


(D.30)  were 
number  of  LG 
mission  rate 


used  to  eliminate  the  following  state  variables: 
launch  sites  (X320),  OSV  payload  (X510).  OSV 
(X501),  and  LG  mission  rate  (X301).  respectively 
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(see  Figure  4.14  or  Appendix  D  for  equations  and  Table  4.9 
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or  Appendix  E  for  the  state  variables).  This  method  of 
state  variable  elimination  is  a  standard  technique  (Wismer 
and  Chattergy.  1978:  57)  which  ensures  implicit  satisfac¬ 

tion  of  the  equality  equation,  while  reducing  the  dimension 
of  the  problem. 


The  second  method  involves  setting  state  variables  to 
their  technological,  limits  where  allowed  by  model  formula¬ 
tion.  The  state  variable  for  LG  structural  mass  (X325).  was 
eliminated  by  setting  the  LG  structural  mass  ratio  equal  to 
a  constant  instead  of  placing  upper  and  lower  bounds  on  the 
mass  ratio  (see  Eqs  (D.10)  and  (D.ll).  Appendix  D  or  Figure 
4.14).  Setting  the  mass  ratio  equal  to  a  constant  allows  Eq 
(0.10)  to  become  an  equality  equation  and  eliminates  Eq 
(D.ll).  Then  LG  structural  mass  (X325)  was  eliminated  by 
substitution,  as  in  the  first  method.  The  state  variable 
for  OSV  structural  mass  (X525)  was  eliminated  the  same  way 
as  the  LG  structural  mass  (using  Eqs  (D.18)  and  (D.19)). 


The  structural  mass  ratio  for  the  LG  and  the  OSV  was 
set  equal  to  0.176,  as  this  allows  the  minimum  fuel  to 
achieve  a  given  change  in  velocity.  This  was  considered  a 
reasonable  value  as  it  is  within  the  limits  of  current  tech¬ 
nology:  there  is  no  cost  penalty  in  the  simplified  cost 
estimating  relationships  for  using  advanced  technology  to 
achieve  such  low  structure  ratios.  The  main  loss  from  the 
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above  two  substitutions  is  elimination  of  the  analyst's 


ability  to  evaluate  the  effect  changes  in  the  structural 


mass  ratio  had  on  the  individual  Pi’s. 


The  state  variables  for  LG  reliability  (X345)  and  for 


OSV  reliability  (X545)  were  eliminated  by  setting  the  relia¬ 


bility  equal  to  0.90.  This  value  was  picked  because  the  PI 


for  initial  cost  (Z2)  tended  to  drive  this  value  down,  while 
PI  for  reliability  ( )  tended  to  drive  it  up.  It  was  felt 


that  reliability  for  mission  accomplishment  below  this  value 


would  be  unacceptable  for  a  space  system.  This  action  elim¬ 


inated  the  need  for  Eqs  (D.13).  (D.14),  (D.20).  and  (D.21). 


the  upper  and  lower  bounds  on  the  reliability  variable. 


Setting  the  LG  and  OSV  reliability  equal  to  a  constant  elim¬ 


inates  their  impact  on  the  initial  cost  equations  for  LG  and 


OSV  R&D  and  production  costs. 


The  thi.d  method  of  state  variable  reduction  involved 


simply  setting  certain  state  variables  equal  to  a  constant 


value.  By  not  letting  these  variables  vary  over  their 


feasible  ranges,  information  was  lost  with  respect  to  the 


effect  these  variables  had  on  the  final  solution.  Sensi¬ 


tivity  analysis  (which  will  be  discussed  later)  will  minim¬ 


ize  but  not  eliminate  the  effect  of  this  loss  of  informa¬ 


tion.  The  constant  values  are  relatively  "soft”  and  should 


be  updated  in  future  refinements  of  the  model. 


The  constants  chosen  were  based  on  reasonable  estimates 
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of  real  system  parameter  values.  LG  vehicle  down  time 
between  missions  (X330)  was  replaced  by  the  constant  value 
400hrs.  which  is  within  the  expected  range  of  future  launch 
systems.  Time  between  launches  from  a  specific  launch  site 
(X335)  was  set  equal  to  14  days,  which  is  an  estimate  of 
future  launch  site  turnaround  times.  The  number  of  LG 
stages  (X370)  was  set  equal  to  three.  This  value  is  in  line 
with  past  expendable  launch  systems  and  larger  that  the 
current  NASA  Space  Transportation  System  (Space  shuttle). 

The  LG-OSV  rendezvous  altitude  (X360)  was  set  equal  to  200 
km.  This  value  was  selected  because  it  was  felt  launch  sys¬ 
tem  operating  costs  would  be  a  major  driver  in  determining 
the  final  value  of  this  state  variable.  Since  launch  system 
operating  costs  increase  as  altitude  increases,  a  value  near 
the  minimal  limit  seemed  appropriate.  The  number  of  waiting 
orbits  (X565)  was  set  at  two.  This  value  was  selected  as  a 
reasonable  compromise  between  a  low  value  for  short  missions 
(high  fuel  use),  and  a  higher  value  for  less  OSV  fuel  use 
(longer  missions).  Upon  making  the  above  simplifications 
and  reductions  in  the  number  of  state  variables  the  computer 
program  PROCES  was  run  using  this  model.  The  approach  out¬ 
lined  in  section  5. 2. 1.4  was  used  to  generate  an  NDSS. 

5-3.1  NDSS .  Using  the  approach  described  in  section 

5. 2. 1.4,  and  the  8-state  variable  model  just  described,  the 
program  PROCES  was  used  to  generate  the  NDSS.  The  program 
was  run  with  10  starting  points  using  the  weighted  technique 


to  get  an  initial  image  of  the  NDSS.  The  weighted  technique 
generated  15  X-rea 1 i zat ions  for  the  NDSS.  There  were  20 
different  weights  used  as  shown  in  Table  5.1.  chosen  in 
order  to  find  the  full  range  of  the  PI  values.  Using  the 
ranges  of  the  Zr's  found  (again  see  Table  5.1)  the  program 
PROCES  was  run  using  the  constraint  technique  with  10  start¬ 
ing  points.  The  constraint  technique  generated  an  NDSS  with 
69  distinct  X-rea 1 i zat ions .  This  NDSS  is  presented  in  Table 
5.2.  This  shows  the  state  vector  description  for  each 
member  of  the  NDSS.  For  identification  of  the  meaning  of 
each  variable,  the  reader  is  referred  to  Tables  4.9  and 
4.11. 
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0. 9oo 
0.900 
0.900 
0.900 
0 . 900 
0.9C0 
0 . 300 
u  ■*00 
U.  j:j;i 
0.9Cu 
i'.  900 
0.900 
0.900 
0. 9uy 
0.900 
0. 900 
0.900 
0.900 
0.900 
0.900 
0.900 
0. 900 
0.900 
0.900 
O.OOO 
0  900 
0  900 
0.990 
0.9  Hi 
0 . 900 
0. 900 
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STAGES 

2CO 

3.0 

2G0 

3.0 

200 

3.0 

200 

3.0 

200 

3.0 

200 

3.0 

200 

3.0 

2C0 

3.0 

200 

3.0 

200 

3.0 

2C0 

3.0 

200 

3.0 

200 

3.0 

200 

3.0 

200 

3.0 

2CQ 

3.0 

200 

3.0 

2C0 

3.0 

200 

3.0 

200 

3.0 

200 

3.0 

2oG 

3.0 

2C3 

3.0 

2  00 

3.0 

L  V  j 

3.0 

i:-  0 

3.0 

n 

3.0 

2oO 

3.0 

30.  i 

3  .  !j 

i  7} 

3.0 

3.0 

J  .  0 

u 

j.n 

.  .0 

„.y 

4  y> 

3.0 

2  D 

3.(1 

200 

3.0 

200 

3.0 

2  Co 

3.0 

219 

3.0 

200 

3.0 

ii'O 

3.0 

2"9 

7.0 

SVi 

3.C 

2o0 

3.0 

2U' 

3.0 

..  .  J 

3  0 

ilO 

3.0 

:  i1  ‘j 

3 .  G 

3.0 

200 

3.0 

200 

3.0 

200 

3.0 

2  CO 

3.0 

220 

3.0 

200 

3.0 

200 

3.0 

200 

3.0 

200 

3  0 

200 

3.0 

200 

3.0 

2C0 

3.0 

200 

3.0 

2v,J 

3.0 

2'Jj 

3.0 

i’j J 

3.0 

NDSS 

Resu  i 

Y500 

3501 

8  OSVs 

HiS/YB 

4.01 

534.01 

2.97 

98.86 

2.47 

78.73 

2.13 

10.51 

4.61 

2995.89 

US 

871.65 

5.61 

3123.99 

6.28 

3158.68 

6.46 

2998.69 

4.59 

57.34 

6.8 

3544.66 

6.25 

3474.73 

2.46 

401.51 

2.50 

401.42 

2.51 

401.48 

2.45 

403.25 

2.49 

401.12 

2.48 

401.00 

2.44 

401.27 

2.49 

3*46.68 

2.82 

4u2.S6 

4.06 

564.01 

1.66 

87.38 

3.9b 

5S6.48 

3.2: 

368.15 

3.2 1 

372.21 

?  52 

865.13 

4.24 

2873.83 

4  63 

3009.29 

12.52 

35°. 15 

57.17 

2 18.  O') 

<0  .  5 

2in  :<4 

1 .  1  ■ 

■  '*4  1  ■ 

j  .  / ; 

w  .  U  1 

i: 

\<  "  : 

555  5b 

IX .  i  / 

0.70 

X.ii 

162.23 

657.92 

i  6  2 . 2  2 

657. 3(3 

17.62 

273.64 

1.37 

109.24 

0.22 

0.88 

6  63 

bi2.44 

!  .96 
•  1 

568.83 

Civ,  i  J 

32- 

j  I S .  I  j 

1:3  75 

0  4o 

1 3  j .  a  2 

0  4? 

!33.4t 

0  <7 

108.3*4 

0.  <3 

109.78 

32.96 

279.23 

!.4y 

Vs.lt 

1.04 

252.38 

0.45 

252.49 

O.'l 

252.94 

I. lb 

171.05 

0.4b 

175.47 

0.33 

175.71 

1.28 

84.50 

0.47 

84.41 

O.i? 

84.25 

0.17 

0.&9 

0.4b 

1268.87 

8.19 

1016.42 

7.72 

99l.lt, 

i .  i  i 

945.09 

0  46 

892.7  3 

4  ’ 

'  ■  *!  ( 

911 . 0  j 
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As  was  discussed  in  section  4.3.1.  a  criteria  for  state 


variables  is  that  they  have  a  large  enough  range  of  values 
to  allow  unique  descriptions  of  the  design  alternatives. 
Table  5.3  shows  the  minimum  and  maximum  of  each  state  vari¬ 
able  that  occured  in  the  NDSS.  Each  of  the  8  state  vari¬ 
ables  ranges  over  several  orders  of  magnitude.  The  original 
variables  that  were  eliminated  form  the  state  vector  are 
uniquely  determined  by  these  8  variables.  They  are 
presented  to  give  a  complete  description  of  the  sytems  in 
the  NDSS.  For  example.  X~rea 1 ization  #3  might  look  like 
F i gure  5.10. 

Table  5.3 

Range  of  State  Variables  in  NDSS 


State  Variable 

Maximum 

Minimum 

Value 

Value 

Number  of  MLG  ’  S  137 

MLG  Payload  (kg)  55620 

Mass  MLG  Propulsion  1319690 

Fuel  (kg) 

Number  of  Satellites  69.4 

Serviced  per  OSV  Mission 

Number  of  OSV ’ s  162 

Mass  OSV  Propulsion  187500 

Fuel  (kg) 

OSV  Crew  Size  j  293 

Avg  Mass  Delivered  |  243500 

per  Service  (kg)  1 


0.247 

7056 

168000 

0.0135 

0 . 1704 
56.2 

0.0001 
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This  system  has  approximately  b  LG’s,  about  halt  the 
size  of  NASA’s  space  shuttle.  They  perform  134  missions  per 
year  from  5  launch  sites.  The  LG  supports  approximately  2 
OSV ’ s  each  with  an  8  man  crew.  it  takes  2  OSV  missions  to 
service  each  satellite  with  3500  kg  of  supplies.  The  OSV ’ s 
perform  about  79  missions  per  year. 

5.3.2  Validation  Results.  The  validity  of  the  NDSS  gen¬ 

erated  was  examined  in  three  ways.  First,  the  range  of  the 
state  variables  was  looked  at  for  realizability  and  sensi¬ 
bility.  Second,  the  optimality  of  the  members  of  the  NDSS 
was  checked  to  ensure  that  PROCES  had  generated  a  mathemati¬ 
cally  valid  NDSS.  Then  sensitivity  analysis  was  done  to 
identify  which  problem  factors  strongly  affected  the  NDSS, 
and  which  parameters  strongly  affected  the  model .  Sensi¬ 
tivity  was  also  used  to  check  the  validity  of  the  techniques 
used  to  reduce  the  dimension  of  the  state  vector. 

5.3.2. 1  Realizability  and  Sensibility.  Table  5.3  also 
shows  that  some  of  the  state  variables  take  on  values  that 
are  unrealistically  high,  and  are  probably  beyond  the  range 
of  the  simplified  model  equations. 

The  Number  of  LG’s  (X300)  ranges  from  0.24  to  137.  The 
realization  for  the  system  with  one-quarter  of  an  MLG  is 
number  43.  This  realization  has  the  largest  LG  payload  size 
and  one  of  the  largest  structures,  about  the  same  size  as 
the  Shuttle  Derived  Vehicles  (NASA.  1985:  1-272).  The  OSV 


for  this  system  is  large,  and  not  fully  utilized,  while  the 


1 


mass  delivered  to  each  satellite  is  a  modest  1092  kg.  The 
components  of  this  system  design  are  all  realistic  values 
within  the  available  technology.  This  lower  bound  for  X300 
is  probably  a  reasonable  value  if  it  is  interpreted  as  the 
part  time  use  of  a  large  LG.  The  state  variable  for  number 
of  LG’s  had  an  upper  value  of  137  (system  64).  This  LG  has 
a  payload  of  18000  kg,  making  it  approximately  the  size  of 
the  shuttle.  This  number  of  LG's  is  probably  beyond  the 
range  that  the  cost  estimating  relationships  were  designed 
to  handle.  In  addition,  the  system  requires  108  launch 
sites.  The  cost  relation  for  building  launch  sites  is  based 
on  only  a  few  sites;  this  many  is  again  beyond  the  reason¬ 
able  application  of  the  relationship.  Also,  this  system 
delivers  over  182501  kg  to  each  satellite  every  3  years,  far 
beyond  the  anticipated  needs  of  satellites  for  the  near 
future . 

The  payload  mass  of  the  LG  (X310),  ranges  from  7000 
kilograms  to  55600  kilograms.  Associated  with  this  state 
variable  is  the  fuel  mass  consumed  by  the  LG.  which  has  a 
range  of  168200  kg  to  1320000  kg.  This  range  of  values  is 
well  within  the  range  of  currently  exsisting  or  planned  sys¬ 
tems  (NASA,  1985:  1-249  to  1-282). 


The  number  of  0SV '  s  (X500),  ranges  from  0.17  to  162. 
The  minimum  number  of  0SV ' s  is  for  system  863.  While  this 


many  0SV ’ s  could  be  thought  of  as  part-time  use  of  a  single 


OSV .  the  size  of  the  OSV  needed  to  perform  this  mission  on  a 


part-time  basis  is  beyond  the  reasonable  bounds  of  our 
model.  To  perform  this  mission,  the  OSV  must  visit  over  69 
satellites  between  each  reservicing,  which  is  probably 
beyond  the  range  of  our  simplified  orbital  mechanics  model. 
Also,  the  crew  size  of  the  OSV  is  unrealistically  large  at 
over  250  people. 

The  OSV  crew  size  (X555)  ranges  from  0.001  persons  on 
board,  to  293  people  in  an  OSV  crew.  The  value  of  0.001 
persons  is  allowed  by  our  model  and  simply  means  that  there 
is  really  no  crew  on  the  OSV.  The  293  crew  size  is  not 
prevented  by  our  model,  but  life  support  considerations  were 
based  on  data  for  20  crew  members  or  less.  Therefore,  crew 
sizes  larger  than  20  have  rapidly  decreasing  validity. 

The  OSV  fuel  mass  consumed  per  mission  (X52b)  ranges 
from  56  kg  per  mission  to  187540  kg.  The  minimum  value  of 
56  kg  per  mission  is  associated  with  system  39,  which  has  a 
value  for  number  of  satellites  visited  per  mission  of  0.07. 
This  is  not  a  realistic  value  for  number  of  satellites 
visited  per  mission.  It  allows  unrealistically  low  esti¬ 
mates  of  OSV  fuel  needed  per  mission.  The  maximum  value  of 
OSV  fuel  consumed.  187540  kg,  is  associated  with  system  52, 
and  while  it  is  realistic  from  an  engineering  point  of  view, 
the  payload  delivered  per  satellite  service  is  over  183000 
kg.  This  is  probably  far  beyond  the  needs  of  current,  or 
envisioned  future  systems. 
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The  number  of  satellites  serviced  per  OSV  mission. 

X560 .  ranges  from  a  low  of  0.01  to  a  high  of  b9.4  satellites 
serviced  per  OSV  mission.  In  reality,  this  should  be  an 
integer  value,  but  this  is  not  allowed  by  our  analysis  tech¬ 
niques.  An  approximation  with  real  numbers  was  used.  This 
was  valid  for  some  of  our  equations  dealing  with  mass 
delivered  or  used  by  the  various  subsystems.  However,  the 
equation  determining  the  OSV  fuel  requirements  (Eq  (D.22)) 
is  invalidated  as  this  variable  takes  on  values  less  than 
one.  The  high  value  of  69.4  is  within  the  reasonable  range 
as  the  orbital  mechanics  is  concerned,  but  since  it  is  asso¬ 
ciated  with,  system  63,  it  is  already  invalidated  due  to  the 
extreme  size  of  the  OSV. 


The  mass  delivered  for  service  to  each  satellite  in 
each  three  year  service  interval  (X561)  ranges  from  a  high 
of  243000  kg  to  a  low  of  545.5  kg.  The  high  value  of  243000 
kg  is  delivered  by  system  6.  which  is  sized  sufficiently 
large  to  deliver  such  a  mass,  but  this  mass  is  probably  far 
beyond  what  any  satellites  currently  envisioned  might  need. 
The  bottom  of  the  range  545.5  kg  is  large  enough  to  serve 
smaller  satellites,  or  large  satellites  with  minimal  service 
needs  . 


5. 3. 2. 2  Optimality  Check  Results.  The  optimality  of  the 
NDSS  was  tested  by  the  methods  discussed  in  section  5. 2. 2. 2 
Results  showed  that  in  spite  of  the  nonconvexity  of  this 
model,  the  NDSS  generated  was  Pareto  optimal. 


5-39 


888 


’*  >  V  ‘j*  v>  *  -  .  • 


/  „*  „ 

•  a.  • 


5 .3. 2. 3  Sensitivity  Analysis.  The  results  of  the  sensi¬ 
tivity  analysis  will  now  be  presented  in  three  parts. 

First,  the  sensitivity  of  the  NDSS.  second,  the  model  sensi¬ 
tivity  and  third,  the  effect  of  large  changes  in  the  model 
parameters  on  the  NDSS. 

5. 3. 2. 3.1  NDSS  Sen i t i v i ty  .  Sensitivity  was  performed  on  the 
entire  NDSS.  To  give  more  meaning  to  the  results  a  subset 
of  the  NDSS  will  be  evaluated.  This  subset  of  the  NDSS  is 
identified  in  Chapter  VI  (Decision  Making).  It  consists  of 
members  ranked  highly  across  a  broad  range  of  decision 
maker’s  preferences.  Each  state  variable  of  the  reduced 
model  will  be  evaluated  separately.  The  Pi’s  which  are 
affected  will  be  identified,  and  the  magnitude  of  the 
effects  will  be  shown.  For  each  of  the  NDSS  members,  the 
eight  state  va r i ab 1 es ( SV )  were  changed  in  increments  of 
2, 4. 6. 8  and  10  percent. 

The  data  which  appears  in  Table  5.4  for  each  PI  is  for 
10  percent  changes  in  the  state  variables.  The  columns 
under  each  state  variable  contain  five  numbers.  The  first 
entry  is  the  actual  value  of  the  SV .  the  second  through  the 
fifth  entries  are  the  percent  change  in  the  Pi’s.  For  exam¬ 
ple.  solution  number  two  has  variable  X300.  equal  to  7.3. 

The  operations  cost  sensitivity  to  a  10  percent  change  in 
X300  is  0.577  percent.  The  initial  cost  had  a  sensitivity 
of  1.45  percent  for  a  10  percent  change  in  X300.  The  relia 
bility  sensitivity  was  0.0001  percent  for  a  10  percent 


change  in  X300.  and  there  was  no  significant  change  for  mass 


delivered  per  hour  sensitivity  analysis. 

Table  5.4 

NDSS  Sensivivity  to  Changes  in  X  Values 


0.0152 

-0.093 


0.01b 

-0.0-17 


VALLE 
%  CHG 

VALLE 
%  CHG 

2.97 

9.25 

0.333 

0.053 

8310 

0.022 

0.172 

2.47 

9.5b 

0.351 

0.148 

834b 

0.01 

0.112 

1 .88 
0.022 
0.101 
0.4bb 

179132 

0.74b 

0.242 

5.b09 

8.72 

0.38 

0.001 

521 

0.023 

0.013 

6.28 

5.b8 

0.342 

0.0001 

554 

0.012 

0.024 

X300-  s  of  LG  systems 
X310-  Pa 'load  mass  per  launch  (hft) 
X32b-  'lass  of  LG  propills  ion  fuel  (Kg) 
\"><)0  s  ot  0S\  s 

X52b-  'lass  of  0SV  propulsion  fuel  (Kg) 
XT)")")  -  OS!  cr<'v  size 
X5b()-  s  sat.  serviced/OSV  mission 
\3bl-  A\e  mass  delivered  to  a  sat  (Kg) 
-  'lass  De I  i vered/ Hr  (Kg/Hr) 


XI  I  numbers  represent,  the  lug  change  It 


OPS  =  Operating  Costs/Hr  (S/Hr) 

1C  *  Initial  Costs  (S  x  1 000()( )0U() ) 

REL  -  Re  I iubi I ity 

'ID  -  'lass  Delivered/Hr  (Kg/Hr) 


The  sensitivity  data  presented  in  Table  5.4  is  used  to 
interpret,  the  validity  of  the  NDSS.  The  number  of  LG’s 
(X300)  affects  the  NDSS  in  two  of  the  four  Pi’s  ,  operations 
cost  and  initial  cost.  The  operations  cost  is  more  sensi¬ 
tive  across  the  NDSS  with  a  range  of  sensitivity  between 
9.23  percent  to  0.419  percent  for  solution  numbers  6  and  3 
respectively.  In  the  original  model,  the  number  of  LG's  did 
not  appear  in  the  equation  for  operations  cost.  Operations 
cost  is  affected  in  the  reduced  model  because  the  equality 
constraints  were  used  to  substitute  this  variable  into  the 
operations  cost  equation.  The  initial  cost  sensitivities 
range  from  6.81  percent  to  1.42  percent  for  solutions  six 
and  three  respectively.  The  payload  mass  of  the  LG  (X310) 
has  indirect  impact  on  all  of  the  Pi’s  through  the  con¬ 
straint  (EqCD.29).  This  constraint  requires  that  the  total 
mass  of  the  LG  system  must  be  off  loaded  by  the  OSV  fleet. 
The  mass  of  the  LG  propulsion  fuel  (X326)  affects  operations 
cost  and  initial  cost.  The  sensitivity  of  operations  cost 
ranges  from  0.407  percent  to  9.19  percent  for  solutions 
three  and  six  respectively.  The  initial  cost  range  sensi 
tivity  is  2.20  percent  to  4.35  percent  for  solutions  three 
and  six  respectively.  The  number  of  OSV ' s  ( X500 ) , e f fee t s 
initial  cost,  reliability  and  operations  cost.  The  intial 
cost  and  reliability  are  relatively  insensitive  when  com¬ 
pared  with  operations  cost.  They  have  a  sensitivity  range  of 
1.8  percent  to  9.5b  percent  for  solutions  numbers  six  and 
three.  The  NDSS  is  insensitive  to  small  changes  in  the  mass 


of  the  OSV  propulsion  fuel  (X526).  The  OSV  crew  size  (X555) 
affects  the  operations  cost  and  initial  cost  Pi’s.  Opera¬ 
tions  cost  has  a  sensitivity  range  of  -0.022  percent  to  9.5b 
percent  for  solution  numbers  six  and  three.  Initial  cost 
sensitivity  ranges  from  -0.014  percent  to  -1.46  percent  for 
solution  numbers  six  and  three  respectively.  The  NDSS  is 
insensitive  to  the  number  of  sattellites  serviced  per  OSV 
mission  (X560).  However,  the  entire  NDSS  is  critically  sen¬ 
sitive  to  any  variation  in  the  mass  delivered  per  hour 
(X561).  Mass  delivered,  the  fourth  PI,  will  proportionately 
follow  any  change  in  X561 . 

The  solutions  that  were  most  sensitive  to  variations  in 
the  state  variables  are  solution  numbers  six  and  three. 

These  two  systems  appear  to  be  almost  opposites  in  terms  of 
their  physical  descriptions.  System  number  six  delivers  an 
extreme  amount  of  mass  (1334  KG/Hr)  to  a  satellite  constel¬ 
lation,  whereas  system  three  is  more  resonable  with  an  18 
Kg/Hr  rate.  The  more  nominal  solutions  (numbers  7.8.9)  have 
average  sensitivities  to  the  Pi’s,  and  thus  appear  to  have 
more  stable  operating  points.  The  sensitivity  of  the  opera¬ 
tions  cost  tends  to  rise  as  the  size  of  the  system 
increases.  This  phenomenon  is  counter  to  the  logic  that  if 
more  systems  are  being  used,  and  if  one  subsystem  is  lost 
the  impact  should  be  less.  Upon  closer  examination  of  the 
operations  cost  equations,  it  can  be  seen  that  it  is  qua¬ 
dratic  with  respect  to  the  number  of  LG  launch  systems 


(X300)  and  payload  mass  per  launch  (X310).  Sensitivity  of 
these  two  parameters  is  intimately  tied  to  each  other.  The 
mass  delivered  per  hour  is  extremely  sensitive  to  mass- 
delivered  per  satellite  service  (X561).  Also,  the  greater 
the  amount  delivered  to  a  satellite  at  each  visit,  the 
greater  the  total  mass  delivered  to  the  constellation  of 
satellites.  In  choosing  a  system  to  be  implemented,  this 
table  can  aid  the  decision-maker  in  determining  which 
aspects  of  the  design  to  most  carefully  monitor.  For  exam¬ 
ple,  in  implementing  system  number  8,  operations  cost  be 
lowered  with  little  or  no  effect  on  initial  cost  by  changing 
the  OSV  crew  size  (Table  5.4). 

5. 3. 2. 3. 2  Model  Sensitivity.  Determining  under  what  condi¬ 
tions  the  model  is  valid  can  be  accomplished  by  looking  at 
the  local  sensitivities  of  the  exogenous  variables  of  the 
model;  environment,  structural  and  substituted  state  vari¬ 
ables.  The  enviromental  parameters  define  the  conditions 
under  which  the  model  must  function.  An  example  would  be 
the  number  of  satellites  to  be  serviced.  The  structural 
parameters  are  the  assumptions  used  to  define  coefficients 
of  terms  in  the  Pi’s  and  the  constraint  equations.  While 
some  of  these  values  are  known  very  accurately,  others  may 
may  be  very  crude  estimates.  As  an  example,  the  value  of 
the  earth’s  gravitational  constant  is  well  known  but  the 
exogenous  variable  for  cost/unit  of  OSV  fuel  (U22)  is  some¬ 
what  arbitrary.  Substituted  state  variables  should  be 


evaluated  to  determine  the  impact  of  having  fixed  values. 

Table  5.5  is  similar  to  Table  5.4  except  that  the  exo¬ 
genous  variables  are  changed  one  at  a  time.  For  solution 
number  2  the  operations  cost  had  a  value  of  S13590  and  had  a 
sensitivity  of  0.022  percent  for  a  10  percent  change  in  the 
value  of  U2.  Model  sensitivity  more  readily  displays  sensi¬ 
tivity  trends  between  the  performance  indices.  Table  5.5 
and  Table  5.4  both  use  the  same  \DSS  members  making  com¬ 
parisons  possible.  However,  Table  5.5  only  contains  entries 
for  those  exogenous  variables  that  produced  a  greater  than 
0.01  percent  change  in  a  PI  for  a  corresponding  10  percent 
change  in  the  exogenous  variable. 


These  enviromental  parameters,  the  number  of  satellites 
(IJ2)  and  the  satellite  service  interval  (U3).  produce  a  10 
percent  change  in  mass  delivered  for  a  corresponding  change 
in  their  values.  Although  the  model  is  most  sensitive  to 
these  two  variables,  this  is  insignificant  since  the  entire 
MDSS  is  equally  affected.  Due  to  the  fact  that  the  PI  equa¬ 
tions  were  derived  to  show  relative  differences  and  not 
absolute  values,  the  result  is  a  shifting  of  the  NDSS  along 

the  Z,  <mass  delivered  )  axis  of  the  Z_  space  (performance 
4  P 

index  space )  . 


The  substituted  state  variables  are  insensitive  in  com¬ 
parison  to  the  values  obtained  in  Table  5.4  .  Their 


moderate  values  of  sensitivity 


validate  their  use  as  con¬ 


stants. 


Table  5.5 


Substituted  State  and  Enviroment 
Exogenous  Variables  Sensitivities 


SOLS 

12 

16 

X330 

Note  1 

Note  2 

PI 

VALLE 

VALLE 

VALLE 

VALLE 

VALLE 

VALLE 

%  chg 

%  CHG 

%  CHG 

%  CHG 

%  CHG 

144 

26280 

400 

0.17b 

0.17b 

S2 

OPS 

13590 

0.022 

-0.02 

-0.639 

IC 

192 

2.069 

0.171 

REL 

0.999 

MD 

21.9 

10.0 

-9.09 

S3 

OPS 

20227 

0.0118 

-0.01 

-0.371 

IC 

171 

2.20 

0.112 

REL 

0.996 

Ml) 

19.0 

10.0 

-9.09 

s6 

OPS 

73000 

0.746 

-0.678 

-7.21 

IC 

1149 

4.354 

0.2417 

REL 

0.987 

MD 

1334.0 

10.0 

-9.09 

-1 

OPS 

25988 

0.023 

-0.021 

-1.12 

1C 

25b 

2.87 

0.013 

REL 

0.999 

MD 

224.0 

10.0 

-9.09 

S8 

OPS 

6228 

0.102 

-0.092 

-3.73 

IC 

265 

2.44 

0.024 

REL 

0.999 

MD 

177.0 

10. 0 

-9.09 

39 

OPS 

10557 

0.522 

-0.0475 

-2.29 

IC 

262 

2.52 

0.020 

REL 

0.999 

MD 

173.0 

10.0 

-9.09 

12  - 

s  of  satellites 

1  b  - 

Satellite  service 

interval 

(Hr) 

x330- 

Average 

time  between  missions/LG  (Hr) 

Note  1 

-  This 

is  the  mass  ratio  of  the  LG  struct  tire/ fuel 

Note  2  -  This 

is  the  mass  ratio  of  the  0SV 

structure/ fuel 

OPS  = 

Operating  Costs/Hr  < S/Hr > 

1C  -- 

Initial 

Costs  IS 

x 100000000) 

REL  - 

Rel iabi 1 i tv 

MU  = 

'lass  Del  ivere<l/Hr 

( Ka/Hr ) 

All  numbers  represent  the  1U%  change  level 

Ot  the 

exogenous  variables. 
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The  structual  variables  of  the  aodels  that  caused  a 
greater  than  one  percent  change  in  a  FI  as  a  result  of  a  ten 
percent  change  in  the  structual  variable  are  entries  in 
Table  5.6. 

Table  5.6 


Structural  Exogenous  Variable  Sensitivity 


SOLS  129  130  137  138  179 

PI 

V ALl  E 

VALLE 
%  chg 

1 .25 

VALLE 
%  CHG 

1  .3 

VALLE 
%  CHG 

1  .25 

VALLE 
%  CHG 

1  .  3 

VALLE 
%  CHG 
125000 

s2 

IC 

192 

2.10 

2.10 

5.97 

5.97 

10.0 

S3 

IC 

171 

1  .36 

1  .36 

6.71 

b  .71 

10.0 

S6 

1C 

1149 

0.996 

0.996 

1 .51 

1  .51 

10.0 

mm 

256 

1  .52 

1  .52 

4.48 

4.48 

10.0 

S8 

IC 

263 

2.43 

2.43 

B 

n 

10.0 

S9 

IC 

262 

2.23 

2.23 

4 . 40 

4 . 40 

10.0 

129  -  OSV  technical  development  factor 

130  -  OSV  R&D  team  experiance  factor 

137  -  LG  technical  development  factor 

L  3  8  -  LG  R&D  team  experiance  factor 

179  -  Cost/ man -year  cost  equations 

IC  =  Initial  Costs  (S  xlOOOOOOOO) 

All  numbers  represent  the  10%  change  level 
of  the  exogenous  variables. 

Initial  cost  is  the  only  PI  affected  by  small  changes  in 
these  exogenous  variables.  The  cost /man-year  (1379)  has  the 


greatest  impact  on  the  initial  cost.  Examination  of  the 


ss 


equation  governing  the  initial  cost  (Appendix  D,  Eq  (D.2)) 


revealed  that  U79  is  a  common  factor-  in  everv  term  ol  tire 


equation,  thus  explaining  its  high  sensitivity.  Even  though 


the  cost/man -year  is  sensitive,  it  can  be  accuratly 


predicted,  thus  reducing  its  impact.  Changes  in  U79  results 


in  a  linear  translation  of  the  NDSS  space  along  the  initial 


cost  axis.  The  size  and  shape  of  the  Z  space  does  not 


change:  however,  its  location  is  changed 


Small  changes  in  the  remaining  four  exogenous  variables 


affect  the  R&D  portion  of  the  initial  costs  in  the  same  mag¬ 


nitude.  although  they  have  less  impact  on  total  initial  cost 


as  the  number  of  LG  and  OSV  units  purchased  increases.  Thus 


initial  costs  are  affected  by  the  number  of  units  purchased. 


but  R8eD  costs  are  not.  For  example,  system  number  six  in 


Table  5.6  is  less  sensitive  than  system  number  three  to 


changes  in  the  variables 


5. 3. 2. 3. 3  Large  Model  Parameter  Changes.  The  equality  con¬ 


straints  (Eq  (D.15),  Eq  (D.22),  and  Eq  ( D .  28 )  of  Appendix  IJ ; 


such  that  the  capacity  of  one  subsystem  equals  the  need  of 


another.  For  example,  Eq  (D.15)  requires  that  the  MLG  be 


capable  of  reaching  the  LG-OSV  rendezvous  orbit.  Large 


changes  in  the  exogenous  variables  cause  the  constraints  to 


be  violated  for  particular  members  of  the  NDSS.  For  some 


members,  the  sub-systems  will  then  have  either  excess  capa 


city  or  excess  need.  When  the  NDSS  is  re-optimized  to 


satisfy  these  constraints,  changes  in  its  members  can  be 
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predicted.  To  predict  how  large  changes  in  the  values  .  f 
the  exogenous  variables  would  change  the  \I)SS.  t.hev  were 
varied  over  their  full  range.  The  direction  of  constraint 
violation  was  examined  to  get  an  indication  for  how  the  NDSS 
might  change.  The  results  of  this  check  are  in  Table  5.7. 

Eq  (D.15)  constrains  the  LG  to  have  sufficient  capabil¬ 
ity  to  reach  the  LG-OSV  rendezvous  altitude.  When  this  con¬ 
straint  is  violated  on  the  excess  capacity  side,  tie 
member’s  of  the  NDSS  generated  could  be  expected  to  use 
smaller  or  fewer  LG’s.  It  would  also  be  expected  to  have 
lower  costs  for  the  same  system  performance.  When  this  con¬ 
straint  is  violated  on  the  side  of  excess  requirement,  then 
the  members  of  the  NDSS  change  in  the  opposite,  manner.  If 
this  constraint  is  violated  far  enough,  then  there  might  be 
no  feasible  LG  realization. 

Eq  (D.22)  constrains  the  OSV  to  have  sufficient  fuel 
capacity  to  perform  its  mission.  It  influences  the  OSV  in  a 
similar  manner  as  Eq  (D.15)  influences  the  LG.  In  addition, 
this  change  causes  a  reduction  in  number  or  size  of  the 
LG’s.  Consequently,  the  systems  initial  and  operating  costs 
are  reduced  for  the  same  system  performance.  Violation  of 
this  constraint  on  the  side  of  excess  requirement  would  have 
just  the  opposite  affect  on  the  resulting  NDSS. 


The  LG  delivery  capacity  is  constrained  to  be  large 
enough  to  deliver  the  needs  of  the  OSV  and  the  satellites  to 


the  rendezvous  altitude  by  Eq .  (D.28).  If  this  constraint 

is  violated  on  the  side  of  excess  LG  capacity,  then  again, 
as  for  Eq  (D.15),  the  new  NDSS  will  have  fewer  or  smaller 
LG’s  to  maintain  the  same  capacity.  If  it  is  violated  on 
the  side  of  excess  OSV  or  satellite  needs,  then  the  NDSS 
will  need  more  and  larger  LG’s,  or  will  have  less  system 
performance . 

5 . 4  Summary 

In  this  chapter  we  have  shown  that  for  a  large  mult.iob- 
.jective  problem,  a  set  of  optimal  engineering  solutions  can 
be  generated.  These  solutions  provide  the  decision  maker 
with  a  set  of  Pareto  optimal  solutions.  In  Chapter  VI.  the 
value  system  will  be  used  to  aid  the  decision  maker  in 
selecting  the  most  preferred  system  from  among  the  candidate 
solutions  in  the  NDSS. 


The  validity  analysis  highlighted  the  following  impor¬ 
tant  characteristics  of  the  model. 

1.  The  performance  measures  are  most  strongly  affected  bv 
the  two  exogenous  control  variables:  number  of  sal. el 
lites  in  the  constellation  to  be  serviced  and  the 
satellite  service  interval. 

2.  The  equality  constraint  requiring  the  total  LG  pav load 
to  be  off-loaded  to  the  OSV  fleet  is  the  primary  bind¬ 
ing  constraint.  This  indicates  that  an  intermediate 
drop  point  (SB)  may  be  beneficial. 


3.  The  experience  factor  of  the  design  and  construction 

teams  has  a  strong  effect  on  the  value  of  the  cost  Pis 


Some  good  solutions  were  generated;  however,  the  sim¬ 
plifications  in  this  model  allowed  many  that  were  invalid. 

To  correct  these  problems,  future  iterations  of  the  model 

need  the  following  areas  of  refinement. 

1.  The  state  variable  for  the  number  of  satellites  ser¬ 
viced  per  OSV  mission  (X560)  invalidates  the  equation 
for  determining  OSV  fuel  requirements  ( Eq  (D.22))  when 
it  has  a  value  less  than  one.  However,  in  equations 
involving  things  such  as  mass  needed  or  mass  delivered 
(Eqs  (D.23).  (D.24),  (D.26),  and  (D.28)),  it  is  desir¬ 
able  to  allow  this  variable  to  have  values  less  than 
one.  Setting  X560  equal  to  a  value  of  one  only  in  Eq 
(0.22),  when  it  actually  has  a  value  less  than  one, 
will  produce  the  desired  results  in  the  model  and  elim 
inate  inconsistencies. 

2.  Refine  the  equations  that  define  the  life  support 
requirements  on  an  OSV,  or  limit  the  crew  size  to  the 
model  range  of  less  than  20  people. 

3.  Refine  the  relations  that  represent  the  tradeoffs 
between  performing  the  se^icing  with  higher  levels  of 
automation  (unmanned)  versus  manned  techniques. 

4.  The  current  model  only  examines  relative  costs  for  com 
parative  purposes,  and  does  not  yield  total  costs  for 
the  systems  (see  Chapter  IV).  Improve  the  cost 
estimating  equations  to  allow  their  use  to  predict 
total  versus  relative  costs. 


VI.  Decisionmaking 


b . 1  I ntroduct i on 

The  first  phase  of  the  systems  engineering  approach  has 
been  completely  described  in  the  preceding  chapters.  The 
problem  was  defined,  the  problem  boundaries  and  assumptions 
were  established,  and  a  candidate  architecture  was  proposed 
and  modeled.  The  model  was  then  ranged  iteratively  over  its 
design  space  to  yield  a  set  of  non~domi nated  solutions 
(NDSS)  that  were  optimal  from  a  design  viewpoint. 

This  same  procedure  is  followed  for  every  candidate 
architecture.  The  non-domi nated  solution  set  for  each  can¬ 
didate  is  usually  then  combined  into  a  single  set.  Each 
element  of  the  non~dom i nated  solution  set  represents  a  dif¬ 
ferent  system  that  offers  the  Tiros t  efficient  performance 
measures  for  its  design.  This  combined  set  should  have  each 
of  its  elements  crosschecked  against  the  others  for  non¬ 
dominance,  and  each  dominated  solution  should  be  eliminated. 

As  demonstrated  in  the  last  chapter,  there  were  69  dif¬ 
ferent  choices  in  the  NDSS  for  that  one  candidate  architec¬ 
ture.  If  five  different  architectures  were  being  con¬ 
sidered.  the  NDSS  might  include  as  many  as  350  possible 
solutions.  An  analyst  should  not  bring  a  list  of  350  solu¬ 
tions  to  a  decision  maker  for  him  to  choose  among.  That 
amount  of  information  would  be  overwhelming,  and  it  would 
require  an  extraordinary  amount  of  time  for  the  decision 
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maker  to  review  the  results. 


The  second  phase  of  the  systems  engineering  approach 
eliminates  this  inefficiency.  In  the  second  phase,  a  value 
system  is  designed  that  allows  the  analyst  to  capture  the 
preferences  of  the  decision  maker  in  an  efficient  and 
repeatable  manner.  Solicitation  of  the  decision  maker’s 
preferences  by  the  analyst  requires  only  a  small  time 
investment  early  in  the  design  process.  This  solicitation 
session  provides  all  the  information  necessary  for  the 
analyst  to  design  a  value  system  that  represents  that  deci¬ 
sion  maker’s  preferences.  Chapter  III  showed  how  an  analyst 
then  uses  this  value  system  to  create  a  weighted  hierarchy 
of  objectives  for  determining  a  single  figure  of  merit  for 
each  system  in  the  NOSS.  The  figure  of  merit  is  a  scalar 
index  that  represents  the  decision  maker’s  preferences  for  a 
system.  The  solution  in  the  NDSS  with  the  largest  figure  of 
merit  is  then  the  most  preferred  solution  based  on  the  deci¬ 
sion  maker’s  initial  preferences.  Mow  it  is  possible  for 
the  analyst  to  bring  a  list  of  solutions  to  the  DM  that  have 
already  been  ranked  by  the  DM ’ s  own  preference  structure. 
This  is  a  time-efficient  method  for  both  the  analyst  and  the 
decision  maker.  The  value  system  framework  thus  enables  the 
decision  maker  to  view  the  optimal  choices  with  their  advan¬ 
tages  and  disadvantages.  This  approach  has  the  benefit  of 
traceability  for  any  decision  made.  Since  there  is  written 
documentation  showing  the  ranked  solutions  based  upon  par- 
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ticular  preferences,  a  decision  can  be  reviewed  at  any  time, 
and  changed  if  conditions  warrant  it.  In  addition,  if  the 
preferences  change  for  any  reason,  the  first  phase  of  the 
methodology  does  not  require  reaccomplishment.  The  original 
NDSS  is  still  valid.  With  the  new  preferences  incorporated 
in  a  value  system,  a  revised  ranking  of  solutions  can  be 
quickly  obtained. 


Ranking  the  NDSS  for  a  Satellite  Servicim 


This  section  describes  how  value  systems  were  con¬ 
structed  for  several  decision  makers,  and  used  to  rank  an 
NDSS  for  a  candidate  satellite  servicing  system. 


The  hierarchy  of  objectives  in  Figure  6.1  was  shown  to 
senior  USAF  decision  makers  frTTm  the  USAF  Space  Division, 
the  USAF  Satellite  Tracking  and  Control  Facility,  and  NASA 
(Carlton,  1985;  Crabtree.  1985;  Green.  1985;  Hard.  1985; 
Janson.  1985;  Lemon,  1985;  Sundberg,  1985;  Wimberly,  1985; 
Wittress,  1985;  Zersen,  1985).  Pairwise  comparisons  between 
the  objectives  were  solicited  from  the  decision  makers  in 


personal  interviews,  using  the  procedures  described  in  sec- 


LEVEL 


MINIMIZE 

INITIAL 

LOST 


LEVEL  1 

SELECT  BEST- 
SERVICING  SYSTEM 


MINIMIZE 

COST 


MINIMIZE 
OPERATING 
COST/ TIME 


•—  MAXIMIZE— 
PERFORMANCE 


MAXIMIZE 

RELIABILITY 


•“MAXIMIZE 

MASS  OF  PAYLOAD 
DEL  I VERED/ T I  ME 


Multiple  objective  optimization  techniques  were  used  on 


a  model  for  a  system  of  low~G  launchers  and  orbital  servic¬ 


ing  vehicles  to  obtain  the  NDSS  shown  in  Table  6.1. 


For  simplicity  in  this  example,  linear  value  functions 


were  used  to  demonstrate  the  decision  maker’s  preferences 


over  the  ranges  of  the  performance  index  measures.  Table 


6.2  shows  the  resulting  "values”  for  the  performance  indi- 


cies  of  each  candidate  solution.  When  these  values  are  mul¬ 


tiplied  by  the  weights  in  the  hierarchy  tree  and  summed,  a 


scalar  figure  of  merit  is  obtained  for  that  candidate  solu¬ 


tion.  The  69  candidate  solutions  in  the  NDSS  are  ranked 


based  on  their  individual  figures  of  merit  as  shown  in  Table 


6.3.  Note  that  this  ranking  is  valid  only  for  this  particu¬ 


lar  decision  maker,  since  it  is  based  on  his  preference 


structure  alone. 


Table  6.4  shows  the  tree  weightings  and  rankings  for 


nine  additional  USAF  decision  makers  who  were  interviewed. 


Note  that  the  members  of  the  NDSS  are  ranked  differently  for 


every  decision  maker,  since  each  decision  maker  preferred 


slightly  different  objective  weightings.  This  example  used 


the  same  linear  value  functions  for  each  decision  maker.  If 


different  value  functions  had  been  obtained  from  each  deci¬ 


sion  maker  for  each  performance  measure  (see  section  3.4.1) 


the  differences  in  rankings  might  have  been  much  greater 


This  example  emphasizes  the  reason  for  including  the  deci 


sion  maker’s  value  system  in  a  methodology.  When  a  large 
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set  of  optimized  candidates  have  been  generated,  the  value 


system  provides  an  organized  and  time-efficient  way  for  the 
decision  maker  to  determine  his  preferred  solution. 
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Table  b. 1 

Non-doainated  Solution  Set 


OPS  COST 
(S/hr> 

INITIAL  COST 

($) 

RELIABILITY 
(0  to  1) 

MASS  P/L  DELIV 
(.kg/ hr) 

.454338594e-05 

.8550851380+11 

.999902070O+00 

.8333l8l76e+03 

.  I35902100e-05 

.1922131970+11 

.998936057o-00 

.2192228890+02 

.202274492o+05 

.1709001930+11 

.996610284O+00 

.1898140910+02 

. 180376289e-05 

.1922446950+11 

. 53301 I556o+00 

.2988931890+01 

. 204594492o+05 

.5433275600+11 

.9999754430+00 

.4703456810+03 

.730013359e-05 

.1149853940+12 

.9869382980+00 

.1334333980+04 

.259882988o+05 

.2560557880+11 

.9999974970+00 

.2244153900+03 

.622812256o+04 

.2645706960+11 

.9999994640+00 

.1765845950+03 

.  105575293e+05 

.2620323840+11 

.9999996420+00 

.1733776860+03 

.81046079le+04 

.2419380840+11 

.901215792O+00 

.130233393o+02 

.228850781e+05 

.5022249780+11 

.9999997620+00 

.451818390e+03 

.  196127793^05 

.5088765950+11 

.999999344o+00 

.446176086e+03 

. 363857578e+05 

.7462940670+11 

.9965507980+00 

.6669999390+03 

.363880586^05 

.7464357890+11 

.9968188410+00 

.6669972530+03 

.  3b3867070e+O5 

.7465114830+11 

.996940494e+00 

.6669995730+03 

.366123086o+05 

.7486905550+11 

.  996483088e+00 

.667001343O+03 

. 36387996 le+05 

.7464754380+11 

.9967669840+00 

.667000183o+03 

.364213281er+05 

.7461420240+11 

.99665l947o+00 

.667002686O+03 

.364827695e+05 

.7458303180+11 

.9967654940+00 

.6669783940+03 

.3669734770+05 

.7395592600+11 

.9967569710+00 

.657660950O+03 

.3671350780+06 

.7345548490+11 

.998473763e+00 

.6550649410+03 

.5169854690+05 

.8670656920+11 

.999913096O+00 

.8764791870+03 

.  I07450498e+05 

.4079221960+11 

.978301167e+00 

.1664424900+03 

Table  b.l  (continued) 


SYS 

OPS  COST 
(S/hr) 

iMTIAL  COST 

(S) 

RELIABILITY 
(0  to  1) 

IASS  P/L  DELI V 
(kg/ hr ) 

24 

.  161646494e+05 

.323950899e+ll 

. 99988979 le+OO 

. 1 3797529be+03 

25 

.4551 12354e-04 

.318813389e+ll 

. 999389291e+00 

.9352932740+02 

26 

. 452737 3S4e+04 

•319199191e+ll 

.99938929 le+OO 

.9422906490+02 

27 

.  4021 4539 le+05 

.344222188©+ 11 

.9995174410+00 

.2401060940+03 

28 

-284619883e+05 

.537 167462©+ 11 

.9999480840+00 

.499082275e+03 

29 

.238811 797 e+05 

.536174961^-11 

.9999767540+00 

.4799519960+03 

30 

. 364954 180e+05 

.  793251267e+l 1 

.999999940©+00 

.6669999390+03 

31 

. 181679785e+05 

. 707025060©+ 1 1 

.9999999400+00 

.333999695©+03 

32 

. 181334883e+05 

.653597573©+ 11 

.9999999400+00 

.333999969e+03 

33 

.  128944797e+06 

.662309888©+ 11 

.907147348©+00 

.9999987790+03 

34 

.  180940586e+05 

.51 6531896©+ 11 

.803135395e+00 

.3339986880+03 

35 

. 181072598e+05 

.516100383©+ 11 

.8030703660+00 

.3339965820+03 

36 

. 181062383e+05 

.516681359e+ll 

. 803124368e+00 

•333999786e+03 

37 

.  181074590e+05 

.5166571 93©+ lT 

. 802892069e+00 

.3339990840+03 

38 

. 181040684e+05 

.5 16382966©+ 11 

. 802072167e+00 

. 333999969e+03 

39 

.140240894e+04 

.4575 11 363©+ 11 

.9695393440+00 

.  137747498©+02 

40 

.  1 37 4057 98e+04 

.457504399©+ 11 

.9695156810+00 

. 137357 197 e+02 

41 

. 366246 172e+05 

.830225285©+U 

.9999999400+00 

.6669999390+03 

42 

. 23360239 le+06 

.396003369©+ll 

.957209945e+00 

.333999878©+03 

43 

. 33906 1875e+05 

.183158292e+ll 

.1706537900+00 

.5984146600+01 

44 

.546541680e+05 

.968212972e+ll 

.9999990460+00 

.999999878e+03 

45 

.76922828 le+05 

.848147 497e+ll 

.9889747500+00 

.999999878e+03 

46 

•  512330195e^05 

i 

.604394496©+ 11 

.8281020520+00 

.6670018920+03 

47 


.  I82669199e+05 


681918177e+ll 


999999940e+00 


.334000977e+03 


Table  b.l  (continued) 


SYS 

OPS  COST 
($/hr) 

INITIAL  COST 

(S) 

RELIABILITY 
(0  to  1) 

MASS  P/L  DELI V 
(kg/ hr) 

48 

.  182660195©+05 

i  .531155763e^ll 

.6673121450+00 

.3340000920+03 

49 

. 1 8835789 le+05 

. 509999759e+ 1 1 

.6650015710+00 

.3339999690+03 

50 

.6572 1328 le+05 

.391744594e+ll 

.6589233880+00 

.3339992980+03 

51 

. 51283199 26-05 

.3896630890+11 

.5358787780+00 

.3339887700+03 

52 

. 55 1 737773e-05 

.1150113960+12 

.9999999400+00 

.9999999390+03 

53 

54 

.770759375erO5 

. 344580594e-O6 

.8539030320+11 

.6839465980+11 

.9604982730+00 

.9088378550+00 

.9999996950+03 

.9999998780+03 

55 

.  171641297 e+06 

.6653460890+11 

.6483371850+00 

.9999999390+03 

56 

.  129239195e-K)6 

.6617312870+11 

.5100406410+00 

.9999958500+03 

57 

.3609736880+06 

.5391833910+11 

.9311666490+00 

.6670001830+03 

58 

. 157763391e+06 

.5121726870+11 

.6518776420+00 

.6669997560+03 

59 

. 11921 1594e+06 

.5084299670+11 

.527073860e+00 

.6670021970+03 

60 

. 38023046 9e-06 

.3894435840+11 

.9474980830+00 

.3339998780+03 

61 

. 146280188e+06 

.3631953920+11 

.657747567©+00 

.3339998780+03 

62 

.961322422e+05 

.3567360820+11 

.488609284O+00 

.3339823910+03 

63 

.4794622660+05 

.1875608990+11 

.2363945990+00 

.7843265530+01 

64 

65 

.572337969e+05 

. 353227695e+06 

.9115365380+11 

.8592361880+11 

.649716496e+00 

.9999999400+00 

.1000005980+04 

.6670002440+03 

66 

.4979686720+05 

.8309260290+11 

.9999999406+00 

.6669999390+03 

67 

.6749998440+05 

.6889122200+11 

.9604120660+00 

.6669984740+03 

68 

.4035847660+05 

.7011212490+11 

.6665276890+00 

.6670000610+03 

69 


.4149355860+05 


6761409740+11 


.  662733793©+00 


.  666998474©+03 


Table  b.2 


NDSS  of  Associated  "Values"  from  Linear  Value  Functions 


SYS 

» 

OPERATING 

COST 

INITIAL 

COST 

RELIABILITY 

MASS  OF 

OF  PAYLOAD 
DELIVERED 

1 

.880509675e-00 

.2565213746+00 

.9999021296+00 

.6245199446+00 

2 

.964257956e+00 

.8328745966+00 

.9989360576+00 

. 164293870e-01 

3 

. 946802 139e+00 

.8514058596+00 

.9966103436+00 

.1422538146-01 

4 

.9525613196+00 

.8328472386+00 

.5330116156+00 

.2240017756-02 

5 

.946191967e+00 

.5275880106+00 

.9999755026+00 

.3524946276+00 

6 

.  808007 658e-H)0 

.2261480116-03 

.9869383576+00 

.1000000006+01 

7 

.  931651 175e+00 

.7773648506+00 

.9999975566+00 

.1681853236+00 

8 

.  983620 107e+00 

.7699612986+00 

.9999995236+00 

.1323391356+00 

9 

.9722338326+00 

.7721683386+00 

.9999996426+00 

.1299357566+00 

10 

. 97 868496 2e+00 

.7896398906+00 

.9012158516+00 

.9760179566-02 

11 

.939812601er+00 

.5633258826+00 

.9999998216+00 

.3386096956+00 

12 

.948418677e+00 

.5575424436+00 

.9999993446+00 

.3343811046+00 

13 

. 904305995e+00 

.3511129926+00 

.9965507986+00 

.4998748306+00 

14 

.9042999746+00 

.3509896996+00 

.9968189006+00 

.4998727746+00 

15 

.9043035516+00 

.3509238966+00 

.9969405536+00 

.4998745626+00 

16 

.9037101866+00 

.3490292136+00 

.9964831476+00 

.4998758736+00 

17 

.9043001536+00 

.3509553076+00 

.9967669846+00 

.4998749796+00 

18 

.9042124756+00 

.3512451356+00 

.9966519476+00 

.4998768876+00 

19 

.9040508876+00 

.3515162176+00 

.9967654946+00 

.4998586776+00 

20 

.9034865506+00 

.3569687606+00 

.9967570306+00 

.4928758446+00 

21 

.9034440526+00 

.3613199896+00 

.9984737636+00 

.4909302596+00 

22 

.8640336396+00 

.2461045986+00 

.9999130966+00 

.656866431e+00 

b  10 


/'r 


•  v  V  V  V 
•  '  V*  VV Vv 


OPERATING 

COST 

INITIAL 

COST 

RELIABILITY 

MASS  OF 

OF  PAYLOAD 
DELIVERED 

23 

.971740663e+O0 

.645320177e+00 

. 978301 167e+00 

. 1247382610+00 

24 

.  957487226e+00 

.7183314560+00 

.999889791e+00 

25 

. 9880306 12e+00 

.722798407o+00 

.999389350e+00 

.700943917e-01 

26 

. 98809 3078e-KX) 

•  722462952e+O0 

.999389350O+00 

,706l88008e-01 

27 

.  894236386o+00 

.  700706005e+00 

.9995l7500e+00 

.  I79944515o+O0 

28 

.925l45388e+00 

.  532944 143e+00 

.999948084O+00 

. 37403 1007e+00 

29 

.  937 1 92857e+00 

. 533807 099o+00 

.9999767540+00 

.359694064O+00 

E3 

.  904017627e+00 

.310284615O+00 

. lOOOOOOOOo+Ol 

.499874830c+00 

31 

.  952218473o+00 

.3852564990+00 

. 100000000e+01 

.250311911e+00 

32 

.952309191o+00 

.431710631O+00 

. 100000000e+0l 

.250312120O+00 

33 

. 660877228e+00 

.4241354470+00 

.907147408O+00 

.749436617e+00 

34 

.952412903e+00 

.550886333e+00 

.803135395o+00 

.250311166o+00 

35 

. 952378 154e+00 

.5512614850+00 

.803070366o+00 

.250309557e+00 

36 

.  952380836o+00 

.550756395O+00 

.803124368O+00 

.2503119710+00 

37 

. 952377617e+00 

.550777376O+00 

.802892148e+00 

.250311434O+00 

38 

. 952386558e+00 

.551015794O+00 

.802072167o+00 

.250312120O+00 

39 

.99631 1665e+00 

.602203429O+00 

.9695393440+00 

. 103233149O-01 

40 

1  i  .:i  n 

.602209608O+00 

.96951 5681 e+00 

. 102940649e-01 

41 

.903677821O+00 

.2781365510+00 

. lOOOOOOOOo+Ol 

.499874830O+00 

42 

.385629475e+00 

.6556833390+00 

.  95721 0004O+00 

.250312060O+00 

43 

.910827279O+00 

.840747714O+00 

.  170653790e+00 

.4484744280-02 

44 

.856260419O+00 

.158159092O+00 

.999999046O+00 

.7494375110+00 

45 

.797694206O+00 

.2625534830+00 

.988974750e+00 

.7494375110+00 

46 

.8652579780+00 

.4744916560+00 

.828102052O+00 

.4998762610+00 

Table  b.2  (continued) 


OPERATING 

COST 

INITIAL 

COST 

RELIABILITY 

MASS  OF 

OF  PAYLOAD 
DELIVERED 

47 

.951958299e-00 

.4070864326+00 

. 100000000e+01 

.2503128956+00 

48 

,951960623e-00 

.5381711726+00 

.6673121456+00 

.2503l2209e+00 

49 

.950462162er+00 

.5565658816+00 

.6650015716+00 

.2503121206+00 

50 

.8271539816+00 

. 659386277 e-OO 

.6589234476+00 

.2503116136+00 

51 

.8651260146+00 

.6611960536+00 

.5358788376+00 

.2503037456+00 

52 

.8548938636-00 

. 000000000e+00 

. lOOOOOOOOe+Ol 

.7494375716+00 

53 

.7972915176-00 

.257549256e+00 

.9604982736+00 

.7494373926+00 

54 

.9375859056-01 

.4053227906+00 

.9088379146+00 

.7494375116+00 

55 

.5485861306-00 

.4214954976+00 

.6483371856+00 

.7494375716+00 

56 

.660102963e-00 

.4246385106+00 

.5100407006+00 

.7494344716+00 

57 

.5064502366-01 

.5311912896+00 

.9311667086+00 

.4998749796+00 

58 

.5850847966+00 

.5546765926+00 

.6518777016+00 

.4998747116+00 

59 

.6864753966+00 

.5579307686+00 

.5270738606+00 

.499876469e+00 

60 

.0000000006+00 

.6613869676+00 

.9474980836+00 

.2503120606+00 

61 

.6152854566+00 

.6842092286+00 

.6577476266+00 

.2503120606+00 

62 

.7471737276+00 

.6898254166+00 

.4886092846+00 

.2502989476+00 

63 

.8739021426+00 

.8369197256+00 

.2363945996+00 

.5878037776-02 

64 

.8494759606+00 

.2074380676+00 

.649716496e+00 

.7494420416+00 

65 

.9071016916+00 

.2529121946+00 

. lOOOOOOOOe+Ol 

.4998750096+00 

66 

.8690350066+00 

.2775272136+00 

.lOOOOOOOOe+Ol 

.4998748306+00 

67 

.8224760896+00 

.4010052986+00 

.9804121266+00 

.4998736986+00 

68 

.8938578376+00 

.3903898006+00 

.6665277486+00 

.4998748906+00 

69 


.  89087 2598e-00 


.4121096136+00 


.  662733793e-+00 


.4998736986+00 


Table  6.3 


NDSS  Ranking  Based  on  Figures  of  Merit  for  One  DM 


Top  Third 

Figure  of 
Merit 

.858118594*00 
.  849384725*00 
.8l7836702eO0 
.  817656755*00 
.  817342460*00 
.  8037502 17eOO 
. 7862681 15*00 
.786089540*00 
.781112671*00 
.765252054*00 
.750593960*00 
.733907580*00 
.703526616*00 
.  703519464*00 
.692387283*00 
.689704537*00 
.681706667*00 
. 675097 167*00 
.674569130*00 
.673099220*00 
.671538889*00 
.666589916*00 
.663294911*00 


Sys 

8 


3 
2 
8 
9 
7 

10 

25 

26 
24 

27 

4 
23 
40 
39 
11 
12 
63 
43 
29 

28 


]]  Middle  Third  H 

Bottom  Thin 

i 

Figure  of 

Sys 

Figure  of 

Sys 

Merit 

8 

Merit 

8 

.651489913*00 

61 

.  56 1 895788e-*O0 

Q 

.  6437308 19eOO 

51 

.  56 1 873794eOO 

m 

.641 8637 Q4e-O0 

35 

.56l858594e-*O0 

15 

.6416481 14*00 

34 

.56184l726e-*O0 

17 

.641560912*00 

36 

.560508609*00 

16 

.641525388*00 

37 

.551585495*00 

57 

.  64 1 504824*00 

38 

.537159026e-O0 

30 

.636705041*00 

62 

.528886318*00 

69 

.618957460*00 

60 

.517103553*00 

41 

. 61627221 1*00 

49 

.  516533673eOO 

68 

.608297467*00 

32 

.512307286*00 

66 

.605491996*00 

48 

.505971253*00 

1 

.598767281*00 

46 

.502208829*00 

45 

.592924237*00 

47 

.501837909*00 

65 

•  579368234e-*O0 

31 

.498763144*00 

22 

.579171598*00 

67 

.498706698*00 

55 

.  57 6393723*00 

58 

.493133515*00 

53 

.568370223e-*O0 

33 

.486184984*00 

56 

.568158567*00 

21 

.484702557*00 

54 

.  5654500 1 3e-*O0 

59 

.446978092*00 

44 

•  565l81851eOO 

20 

.404105812*00 

64 

.562158108*00 

19 

.350451410*00 

6 

.561987162*00 

18 

.348350018*00 

52 

3 

42 

50 
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6.3.1  Deve lopment .  As  illustrated  in  the  last  section, 
each  solution  in  the  NDSS  is  ranked  based  on  the  decision 
maker's  predetermined  preferences.  However,  preferences  do 
change,  sometimes  due  to  external  variables  beyond  the  con¬ 
trol  of  the  decision  maker.  If  the  analyst  has  determined 
how  sensitive  any  particular  solution  is  to  changes  in  the 
original  preferences,  he  can  provide  a  wealth  of  information 


that  the  decision  maker  can  use.  Since  a  decision  maker  may 
be  concerned  about  "selling”  his  choice  of  a  solution  to 
others  (his  boss.  Congress,  etc.),  a  solution  that  stays 
highly  ranked  over  a  wide  range  of  preference  weightings  may 
be  more  attractive  to  the  DM  than  his  original  top-ranked 
system.  Or  several  decision  makers  may  be  involved  in 
selecting  a  solution,  and  a  so+ution  that  stays  in  a 
highly-ranked  position  over  a  range  of  preference  weightings 
may  be  the  best  compromise.  This  section  describes  one 


method  for  accomplishing  this  sensitivity  analysis  to  deter¬ 
mine  the  robust  solutions  in  the  NDSS. 

By  varying  the  preference  weightings  for  the  objectives 
at  each  level  of  the  hierarchy  tree,  one  can  determine  a 
solution's  robustness  and  frequency  of  occurrence  within  the 
positions  of  interest.  Ideally,  all  weightings  in  the 


number  of  combinations  possible.  Keeping  the  decision 
maker's  value  functions  constant  and  changing  each  prefer¬ 
ence  weighting  by  0.1  increments  would  yield  729  possible 
combinations  for  the  simple  hierarchy  tree  in  Figure  6.1. 
Fortunately  this  is  not  necessary.  It  is  possible  to  deter¬ 
mine  where  significant  changes  in  the  solution  ordering 
occur  by  examining  one  hierarchy  level  at  a  time.  This  may 
indicate  the  general  trend  of  system  ordering  throughout  all 
cases  . 

As  an  example,  the  level  3  objective  weightings  in  Fig¬ 
ure  6.1  are  varied  from  0.1  to  0.9  in  increments  of  0.1. 

The  initial  cost  and  operating  cost  indices  are  then  multi¬ 
plied  by  the  DM  "values”  (Table  6.2)  and  summed  to  get  a 
cost  "sub-figure  of  merit”  (se*6~  Figure  6.3).  This  sub¬ 
figure  of  merit  represents  the  preference  for  each  solution 
in  the  NDSS  based  on  the  cost  objectives  of  Level  3.  The 
NDSS  may  now  be  rank-ordered  for  each  change  in  weighting 
using  this  cost  sub-figure  of  merit,  as  shown  in  Table  6.5. 
The  same  procedures  are  followed  for  the  performance  objec¬ 
tives  of  Level  3  to  yield  the  rankings  in  Table  6.b.  It  is 
now  possible  to  determine  which  weightings  at  this  level  are 
significant  in  producing  system  ordering  variations.  A  dis¬ 
cussion  of  this  follows. 


6-16 


Initial  Cost  Weiihtlnt  (ILW) 

(where:  Ups  Cost  Weiihtir»t  (Ul“l-W>»  1  -  ICW 


rj  n  m 


■  Sl5  SR3SS38  3  S  Sl:  2?  8  HI  «  U  < 


o  9  &  r*»  ii 


O  a  y  r-  in  t> 


«a3R32S883::S!$fi3  3fiiS33& 


»7nNinovhn32-9^«NNifl*5N  x>  ®  T'  m 
c  NNNN(Nl«frtinin,j-  - 


«!  2  r  n  r  s  ;  2  u  s  r  :  n  r  a  r, 


J  ;  St  ,5  N  ^  2  3  §  S  R  5  2  fi  S  3  fi  S  :  3  S  10  S  U  P 


T  ?  r  ?  u  n  ?  m  n  s  ^5  :  ,n  u  s  ^ 


'  "  n  ?  S  ^  3  S  S  U  ?  2  3  3  :  U  S  U  S 


7)  >•  i/1  H  lil  £  CC  <  ^  5C  -  2  U 


^sassr c  v 


""SSSS^afiSSSiBSSSSSS*,* 


N  N  "  S3  n  S  R  S  2  n  H  ?  5  8  2  S  S  2  ’  2  ? 

:  2  ;  s  ?;  n  a  n  3  "  1  "  n  U  N  S  "  S  S  SS  S  SO  fi  S  2  s  5  ?3  :s  2  ’  ! 


1 


R  “’  :  2  U 


N  Q  P- 

-f  3  (N 


r  nsrnR  SU  2  8  3  S3 


H  °  :  2  3  s  S  5  n  S  3  2  ,n  11  *  '  n  s  R  fi  13  S  R  H  ;  S  3  N  "  R 


«  is  r  n  n  a  ^  -  s  ?  ^  n  ^  ^  ?! !;  s  ®  ^  r  ? 


3  3  3 


S^SQS3N"R5 


s 


33($8&8Rr'35S3;»a’*3a?SS!Qf',r,KS 


■ 


;  n  P!  S  3  3  ^  R  U  ?  ?  3  S  U  "  ”  R  R  R  N  "  R  3 


6.5.  it  is  apparent  that  there  is  no  dramatic  change  in  sys¬ 
tem  ordering  as  the  preference  weightings  are  varied  for 
initial  and  operational  costs.  The  rankings  generally  have 
small,  smooth  variations  across  the  range  of  weightings.  To 
simplify  the  overall  sensitivity  analysis,  certain  generali¬ 
zations  may  be  made  from  observing  some  of  the  characteris¬ 
tics  of  Table  6.5. 

The  preference  weightings  of  0.1  and  0.9  in  Table  6.5 
can  be  disregarded  in  further  analysis  for  two  reasons. 
First,  system  ordering  under  these  weightings  have  small 
variations  from  weightings  of  0.2  and  0.8.  Secondly,  it  is 
highly  unlikely  that  a  military  decision  maker  would  prefer 
minimizing  operational  cost  nine  times  more  than  minimizing 
initial  cost  and  vice  versa.  Consequently,  analysis  on  ini¬ 
tial  cost  and  operational  cost  weighting  values  can  be  lim¬ 
ited  to  0.2-0. 8.  Since  there  are  only  small  variations  in 
the  system  rankings,  and  smooth  transitions  within  this 
range,  preference  weightings  of  0.2,  0.4.  0.6.  and  0.8  can 
be  used  as  representative  samples  for  performing  further 
analysis.  This  allows  the  analyst  to  determine  general 
characteristics  of  the  solution  set  ranking  for  different 
preference  weightings,  while  eliminating  the  need  to  run 
every  possibility. 

Some  of  the  system  rankings  in  Table  6.6  for  the  per¬ 
formance  sub-figures  of  merit  changed  dramatically  as 


weightings  were  varied.  Most  of  these  changes  in  the  system 
ordering  occurred  within  the  range  of  0.3  to  0.9.  Also  sys¬ 
tem  rankings  for  the  sub-figure  of  merits  for  reliability 
equal  to  0.1  and  0.2  have  small  deviations  from  the  rankings 
for  reliability  equal  to  0.3.  Therefore  weightings  for 
reliability  of  0.1  and  0.2  are  disregarded  since  they  are 
well  represented  by  the  rankings  in  0.3  weighting  column. 
Reliability  weightings  of  0.3.  0.5.  0.7.  and  0.9  are  then 
used  as  representative  samples  for  the  range  of  weightings 
between  0.3  and  0.9. 

The  range  of  weightings  identified  above  for  level  3 
can  be  combined  with  weightings  from  level  2  to  determine 
the  general  changes  in  overall  system  ordering  for  any 
likely  case.  The  Overall  Costr~Weighting  (0CW)  and  Overall 
Performance  Weighting  (0PW)  from  level  2  are  allowed  to 
range  from  0.1  to  0.9  in  increments  of  0.2.  All  possible 
combinations  of  these  weightings  are  combined  with  the 
weightings  from  level  3  to  determine  an  overall  figure  of 
merit  for  each  system.  This  generates  80  different  cases  of 
possible  system  rankings,  and  the  results  are  shown  in 


Tables  6.7-6.11. 
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Table  6.12 


Systems  Found  in  Number  One  Position 


System 

9 

sTimes  in 

1st  Position 

X  Time  in 

1st  Position 

6 

31 

38.75 

3 

19 

23.75 

8 

18 

22.50 

2 

7 

8.75 

7 

3 

3.75 

33 

1 

1  .25 

44 

1 

1.25 

Note-Va 1 ues 
varied 

taken  from  total  of  80  runs  with 
weightings . 

6.3.3  Analysis  of  Overall  Figure  of  Merit  Results.  Table 
6.12  presents  a  summary  of  the  systems  that  appear  in  the 
"top-ranked”  position  for  the  range  of  preference  weightings 
described  above.  A  complete  listing  of  the  system  orderings 
may  be  found  in  Tables  6.7-6.11  for  the  weightings  used. 


Seven  out  of  the  sixty-nine  different  candidates  in  the 
NDSS  (systems  2.  3.  6,  7,  8,  33,  and  44)  appear  in  the 
number  one  ranked  position  for  the  weightings  used.  Each  of 
these  systems  represents  a  unique  combination  of  decision 
maker  preferences.  Systems  which  appear  in  the  top-ranked 
position  with  a  frequency  of  5  percent  or  more  are  shown  in 
Figures  6.4  to  6.7. 
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SYSTEM  3  DESCRIPTION 


18.98  kft  / hour 


*.  V 


To  demonstrate  the  weightings  that  permit  each  of  the 
solutions  to  appear  in  the  number  one  position,  a  plot  of 
the  level  3  objectives  for  constant  values  of  the  level  2 
objectives  is  shown  in  Figure  6.8.  Since  the  hierarchy  tree 
used  has  only  three  independent  objectives,  it  is  possible 
to  hold  one  of  the  objective  weightings  constant,  and  look 
at  a  plane  generated  by  the  other  two  objective  weightings. 
In  this  way  a  decision  maker  or  analyst  can  visualize  what 
conditions  permit  a  particular  system  to  achieve  the  top 
rank i ng . 

For  example,  suppose  an  analyst  has  determined  a  deci¬ 
sion  maker’s  values,  and  wishes  to  determine  how  robust  the 
top-ranked  system  is.  Assume  the  decision  maker’s  values 
produce  weights  corresponding  to  an  overall  performance 
weighting  of  0.9.  reliability  weighting  of  0.5,  and  an  ini¬ 
tial  cost  weighting  of  0.2.  These  values  indicate  that  the 
decision  maker  desires  a  system  with  high  performance  quali¬ 
ties,  moderate  reliability,  and  a  system  which  greatly 
minimizes  operational  cost.  Referring  to  Figure  6.8.  one 
can  see  that  system  6  is  the  top-ranked  system  for  these 
conditions.  In  addition,  the  decision  makers  preference 
weightings  can  change  over  a  wide  range,  and  system  6  still 
remains  ranked  above  the  other  systems.  System  6  remains  in 
the  ’’top”  position  because  its  performance  measures  for  mass 
of  payload  delivered  and  reliability  are  larger,  when  com¬ 
bined,  than  any  other  member  of  the  NDSS.  A  physical  reali¬ 
zation  for  system  6  is  shown  in  Figure  6.6. 


figure  b  .  8  Preference  Conditions  tor  bvstems  to 


Appear  in  Top  Position 


If  a  decision  maker  were  trying  to  "sell”  his  choice  of 
system  to  a  group  with  many  diverse  preferences,  he  might  be 
interested  in  a  system  which  appeared  in  the  number  one 
position  over  the  widest  range  of  values.  Alternatively  he 
may  choose  to  select  a  system  which  stays  within  the  top 
five  positions  over  the  largest  range  of  weightings.  Before 
selecting  a  system,  it  is  suggested  that  the  decision  maker 
examine  the  systems  which  fall  below  the  "top-ranked”  posi¬ 
tion.  to  determine  if  other  solutions  may  be  more  robust. 
Since  the  attributes  in  the  NDSS  describe  the  level  of 
objective  attainment,  the  decision  maker  can  determine  the 
"cost”  of  selecting  a  lower-ranked  system  by  referencing  the 
NDSS.  The  lower-ranked  system  is  still  an  optimal  performer 
from  an  engineering  viewpoint,  but  it  does  not  necessarily 
yield  the  best  potential  for  tire  objectives  preferred  by  the 
decision  maker.  However,  because  of  its  robustness,  it  may 
be  a  better  system  to  implement. 

Consider  another  example,  where  upon  performing  sensi¬ 
tivity  and  obtaining  the  results,  the  analyst  found  that  the 
system  within  the  number  one  position  would  change  for 
slight  variations  in  the  decision  maker’s  preferences.  The 
analyst  should  inform  the  decision  maker  that  the  system  in 
the  "top"  position  remains  there  only  under  stringent 
preference  conditions.  For  instance,  consider  system  44  in 
this  study.  It  is  the  "top”  choice  for  preference  weight¬ 
ings  of  overall  cost-0.1,  initial  cost=0.8,  and  reliabil- 
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ity=0.9.  Yet.  if  the  preferences  of  the  decision  maker  were 
to  change  slightly,  that  choice  would  be  eliminated  from  the 
number  one  position.  The  decision  maker  needs  to  be 
informed  that  he  might  wish  to  alter  his  preferences  to 
select  a  system  which  meets  a  wider  range  of  values. 


6.3.4  Systems  Within  Top  Five  and  Ten  Positioi 


Genera  1 1 y 


a  decision  maker  would  pick  the  highest-ranked  solution 
(i.e.  system).  However,  there  may  be  cases  where  it  is  more 
beneficial  to  choose  a  system  within  the  top  5  or  10  system 
positions.  Again,  it  might  be  necessary  to  satisfy  a  very 
wide  range  of  preferences.  This  may  lead  the  decision  maker 
to  choose  a  system  within  the  "top”  five  positions  because 
it  appears  in  the  ranking  over  the  necessary  range  of 
preferences  that  he  needs.  If  the  systems  appearing  in  the 
number  one  position  do  not  meet  the  decision  maker’s 
requirements  for  robustness,  a  system  within  the  top  5  or  10 
positions  would  be  the  next  best  choice.  Table  b.13  shows 
the  relative  frequency  of  occurrence  over  the  range  of 
weightings  tested  for  each  of  the  systems  within  the  top  5 
positions.  System  9.  for  example,  represents  a  system  that 
occurs  in  the  top  5  positions  frequently,  but  that  never 
appears  in  the  ’’top-ranked”  spot.  Figure  6.9  provide?  »  phy¬ 
sical  description  of  system  9. 


Similarly.  Table  6.14  lists  the  relative  frequency  each 
system  falls  within  the  top  10  positions  over  the  range  of 
weightings  tested. 
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Systea  S  Tiaes  in  X  Tine  in  I  Syst 


Note-Figures  taken  f  roa 


total  of  80  runs  with  varied  weightings. 


b.4  Summary .  Designing  a  value  system  allows  an  analyst  to 
capture  the  preferences  of  a  decision  maker  in  an  efficient 
and  repeatable  manner.  Once  the  analyst  has  determined  the 
decision  maker’s  preferences,  the  analyst  creates  a  weighted 
hierarchy  of  objectives  from  which  a  scalar  figure  of  merit 
can  be  calculated  for  each  system.  The  most  desirable  solu¬ 
tion  is  usually  the  system  with  the  largest  associated  fig¬ 
ure  of  merit.  However,  it  is  important  to  know  how  sensi¬ 
tive  a  particular  solution  is  to  changes  in  the  decision 
maker's  preferences. 

Sensitivity  analysis  involves  determining  how  sensitive 
a  system’s  ranked  position  is  to  changes  in  the  decision 
maker's  preferences.  This  requires  examining  system  order¬ 
ing  characteristics  as  the  weightings  are  varied.  Ideally, 
system  rankings  for  all  possible  combinations  of  varied 
weightings  could  be  generated  to  determine  the  robustness  of 
the  solution  rankings.  Typically,  though,  generating  all 
possible  combinations  of  all  possible  weighting  values  is  a 
prohibitively  large  task.  Steps  can  be  taken  to  identify 
which  weightings  significantly  produce  system  ordering  vari¬ 
ations.  By  examining  ’’sub-figure  of  merit”  results  at  the 
lowest  level  of  the  hierarchy  tree  of  objectives,  these 
"significant"  weights  may  be  found.  These  ’’significant” 
weighting  values  can  then  be  used  to  represent  those  weight¬ 
ing  values  not  used,  to  calculate  overall  figures  of  merit. 
Although  some  bias  of  system  ordering  may  be  introduced  for 
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those  weighting  values  not  actually  used  in  the  figure  of 
merit  calculations,  making  reasonable  assumptions  from  the 
’’sub-figure  of  merit”  results  can  minimize  the  biases,  and 
produce  useful  information  for  the  decision  maker. 

Using  the  sensitivity  analysis  techniques  demonstrated 
in  this  chapter  permits  a  rigorous  examination  of  possible 
solutions  by  the  decision  maker.  Decisions  concerning  the 
selection  of  a  ’’best”  solution  are  now  made  using  quantifi¬ 
able  measures.  The  value  system  framework  not  only  provides 
a  way  to  structure  and  organize  subjective  judgements,  but 
it  also  produces  written  documentation  showing  why  a  partic¬ 
ular  decision  was  made. 


VII.  Conclusions  and  Recommendations 

7 . 1  1  ntroduct ion 

In  the  preceding  chapters  a  two-phase  approach  for 
designing  a  complex  system  was  presented  and  applied  to  the 
selection  of  a  satellite  servicing  system.  Detailed 
analysis  was  performed  on  one  system  alternative  composed  of 
a  low-G  launcher  and  an  orbital  servicing  vehicle  (LGtOSV). 
Based  on  these  results,  the  following  conclusions  and  recom¬ 
mendations  are  made. 

7 . 2  Cone  1  us  ions 

The  two-phase  approach  is  a  useful  method  for  solving 
complex  problems,  as  shown  in  this  study.  It  provides 
separation  of  the  volatile  decision  making  phase  from  the 
expensive,  t ime- i ntens i ve  engineering  design  phase.  The 
engineering  design  phase  generates  an  optimal  set  of  design 
alternatives.  This  allows  the  decision  maker  to  explicitly 
evaluate  tradeoffs  among  the  conflicting  objectives  without 
requiring  a  completely  new  engineering  analysis  for  each 
tradeoff  . 

This  methodology  was  used  to  generate  an  NDSS  for  a 
LG  +  OSV  servicing  system.  Lise  of  a  value  system  representing 
decision  maker  preferences  enabled  a  ranking  of  the  alterna¬ 
tive  configurations  for  this  servicing  system.  It  was  found 
to  be  time-efficient  to  begin  design  of  the  value  system 


immediately  following  the  problem  definition  step,  and  prior 
to  the  system  modeling.  This  allows  the  same  objectives  and 
attributes  to  be  established  for  both  the  first  and  second 
phases  of  the  approach. 

For  the  LG’-OSV  model,  it  was  found  using  value  system 
sensitivity  analysis  techniques  that  system  designs  2.  3.  b. 
8.  and  9  remained  highly  ranked  over  a  wide  range  of  deci¬ 
sion  maker  preferences.  The  design  variables  for  systems  2 
and  3  all  have  values  within  the  valid  range  of  the  model  at 
the  current  level  of  detail.  Some  of  the  design  variables 
for  systems  6.  8.  and  9  are  beyond  the  valid  range  of  the 
model  for  this  level  of  detail. 

System  2  would  be  selected  if  a  decision  maker  pre¬ 
ferred  a  system  to  have  a  higfi~measure  of  reliability,  but 
made  little  distinction  in  his  preferences  between  minimiz¬ 
ing  operational  versus  initial  costs.  Figure  7.1  helps  one 
visualize  the  conditions  necessary  for  system  2  to  be  ranked 
in  the  ’’top"  position.  Figure  7.2  provides  a  physical 
description  of  system  2. 

System  3  would  be  selected  if  a  decision  maker  pre¬ 
ferred  a  system  that  minimized  initial  system  costs,  and 
also  emphasized  minimizing  the  overall  system  cost.  Again 
Figure  7.1  helps  one  visualize  the  conditions  necessary  for 
system  3  to  be  selected  as  the  ’’top"  system.  Figure  7.3 
provides  a  physical  description  of  system  3. 
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Systems  b.  8.  and  9  all  have  state  variables  (described 


in  Chapter  V)  which  take  on  values  which  are  beyond  the 
valid  ranges  of  the  model.  Though  they  appeared  in  the 
highly  ranked  positions  under  the  conditions  of  Table  6.13. 
and  Tables  6.7  to  6.11.  they  are  invalid  designs  and  should 
not  be  used  as  the  basis  for  further  work,  until  the  model 
is  refined  to  correct  the  problems  identified  in  Chapter  V. 

7 . 3  Recommendations 


For  further  refinements  to  the  value  system  phase  of 
designing  a  satellite  servicing  system,  the  following  recom¬ 
mendations  should  be  considered. 

1.  Use  the  Detailed  Hierarchy  of  Objectives  for  Selection 
of  a  Satellite  Servicing  System  as  described  in  Appen¬ 
dix  B  to  include  more  of  the  concerns  involved  in  this 
complex  problem.  Preferences  should  then  be  solicited 
from  the  decision  maker  bawsed  on  the  new  objectives  and 
new  attributes,  and  new  system  rankings  can  then  be 
determined  based  on  this  detailed  hierarchy. 

2.  For  a  more  detailed  analysis,  don’t  assume  a  linear 
value  function.  Solicit  preferences  from  decision  mak¬ 
ers  who  would  be  involved  in  such  a  system  selection  to 
determine  if  non-linear  value  functions  are  more 
descriptive.  It  is  possible  that  more  of  some  perfor¬ 
mance  measure  may  have  more  value  to  a  decision  maker 
only  up  to  a  point.  Past  that  point  the  value  of  more 
performance  may  actually  decrease.  This  non-monotonic 
value  function  could  possibly  be  modeled  as  a  linear 
combination  of  the  suggested  value  function  forms 
described  in  Section  3.4.2.  These  types  of  conditions 
need  closer  examination. 

3.  Sensitivity  analysis  on  the  value  system  using  a  Monte 
Carlo  technique  will  eliminate  possible  biasing  of 
results.  For  a  large  number  of  trials  (possibly  1000- 
10000).  use  a  random  number  generator  to  produce 
preference  weightings.  These  preference  weightings  can 
then  be  used  with  the  decision  maker's  "values"  from 
the  value  functions  to  determine  the  sensitivity 
characteristics  described  in  Chapter  VI.  Note, 


however,  to  understand  the  conditions  causing  systems 
to  be  "top-ranked”,  each  different  preference  weighting 
must  be  recorded  and  related  to  the  system  ranking  it 
produced  . 


Future  iterations  in  the  modeling  step  should  consider 

the  following  refinements  to  the  model. 

1.  Use  the  Detailed  Hierarchy  of  Objectives  for  Selection 
of  a  Satellite  Servicing  System  as  described  in  Appen¬ 
dix  B  in  the  modeling  phase  for  generating  performance 
measures  for  these  more  detailed  objectives. 

2.  The  state  variable  for  number  of  satellites  serviced 
per  OSV  mission  (X560)  invalidates  the  equation  for 
determining  OSV  fuel  requirements  (Eq  (D.22))  when  it 
has  a  value  less  than  one.  However,  in  equations 
involving  things  such  as  mass  needed  or  mass  delivered 
(Eqs  ( D . 23 ) , ( D . 24 ) , ( D . 26 )  ,  and  (D.28)).  it  is  desirable 
to  allow  this  variable  to  have  values  less  than  one. 
Setting  X560  equal  to  a  value  of  one  only  in  Eq  (D.22). 
when  it  actually  has  a  value  less  than  one,  will  pro¬ 
duce  the  desired  results  in  the  model  and  eliminate 
inconsistencies. 

3.  Refine  the  equations  that  define  the  life  support 
requirements  for  the  OSV,  or  limit  the  crew  size  to  the 
model  range  of  applicability  of  less  than  20  people. 

4.  Refine  the  relations  that  represent  the  tradeoffs 
between  performing  the  servicing  with  higher  levels  of 
automation  (unmanned)  versus  manned  techniques. 

5.  The  current  model  only  examines  relative  costs  for  com¬ 
parative  purposes,  and  does  not  yield  total  costs  for 
the  systems  (see  Chapter  IV).  Improve  the  cost 
estimating  equations  to  allow  their  use  to  predict 
total  versus  relative  costs. 
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